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Consider  the  general  regression  model 

\-  =  g  +  B^X.   +  3^X   +  .  .  .  +  B  X   +  Z   ,   t  =  1,  2,  .  .  ., 
t    o    1  It    2  2t  g  gt    t 

where  the  dependent  variab] e  Y   and  the  independent  variables  X   ,  X   ,  .  . 

X   are  observed  cad   the  vector  of  model  parameters  B'  =  (3  »  6,  j  •  •  •  j 
gt  ~      o   1 

6  )  is  unknown.   The  usual  assumption  on  the  unobservable  errors  {  Z  }  is 
g  ^ 

that  Z, ,  Z„,  Z^,  .  .  .,  Z   are  independent  with  zero  mean  and  constant 
12   3         n 

variance.   When  this  assumption  is  violated,  the  application  of  the  least 

squares  regression  method  will  often  lead  to  erroneous  inferences  on  the 

elements  of  3.   In  order  to  avoid  this  problem,  a  test  for  independence  of 

the  errors  is  essential. 

Many  testing  procedures  have  been  proposed  for  this  problem  and  a 

sunumary  of  the  inost  widely  used  tests  is  given.   However,  th.ese  tests 

attain  I'igh  power  only  when  the  regression  errors  follow  the  first  order 

aiitoregressive  process 

Z   =•  !5Z   ,  +  c   , 
t     t-].     t 


where  |0|<1  and  (e  }  is  white  noise.   VJe  consider  two  tests,  based  on 
the  vector  of  sample  autocorrelations,  which  are  designed  to  have  high 
power  against  a  more  general  autoregressive  alternative:   the  Box-Pierce 
test  and  a  new  procedure  called  the  max-x   test.   An  extensive  Monte-Carlo 
simulation  study  is  undertaken  in  order  to  compare  the  powers  of  the  tests 
under  the  first  order  lag  J  autoregressive  alternative 

where  J  is  not  necessarily  1.   This  particular  model  is  chosen  for  it  is 
one  which  is  near  white  noise,  and  hence  one  for  which  many  testing  pro- 
cedures vjill  fail  to  detect  the  presence  of  serially  correlated  errors. 
A  graphical  display  of  the  simulated  powers  of  the  tests  shows  that 
although  both  tests  attain  a  high  power  in  this  instance,  the  max-x 
test  clearly  outperforms  the  Box-Pierce  procedure. 

The  two  tests  are  also  compared  to  the  Durbin-Watson  d  test  for  several 
least  squares  regression  models.   Since  the  d  test  is  optimal  when  J=l 
in  the  alternative  error  model,  it  is  recommended  as  the  initial  test 
to  apply  in  practice.   However,  the  d  test  performs  poorly  for  J>1  and 

should  be  supplemented  by  another  test  which  has  high  power  in  this  case. 

2 
Power  simulation  results  indicate  that  the  max-X   test  would  be  the  better 

supplementary  test. 

Since  the  problem  of  analytically  deriving  the  exact  powers  of  the 

tests  is  intractable  even  for  simple  alternative  error  m.odels,  asymptotic 

powers  are  coiisidered.   Approximations  to  the  asymptotic  powers  of  the 

2 
Eox-Pierce  and  max-X   tests  are  discussed  and  their  performance  evaluated. 

2 
Comparisons  of  the  Box-Pierce  and  max-X   tests  are  also  made  with 

respect  to  Ilodgcs-Lehmann  efficiency  and  deficiency  and  with  I'espect  to 

likelihood  ratio.   Aluliough  th.e  asj'mptotic  relative  efficiency  of  the 


tests  is  1,  the  Box-Pierce  test  is  sho\m  to  be  asymptotically  deficient 
when  compared  to  the  max-x^  test.  A  derivation  of  the  likelihood  ratio 
statistic  for  special  cases  of  the  problem  reveals  that  the  max-x  test 
is  asymptotically  equivalent  to  the  likelihood  ratio  test. 


CtlAPTER  I 
INTRODUCTION 


1.1     The  Problem 


Consider  the  general  regression  model 

where  the  dependent  variable,  Y  ,  and  the  independent  variables,  X  , 

....  X   ,  are  observed  and  the  random  error,  Z  ,  is  unobserved,  t  =  1, 
gt  t 

2,  .  .  .,  n.   In  m.ost  practical  cases,  the  vector  of  model  parameters, 
^'  =  (13  ,  3    .  .  . ,  g  )  will  be  unknown.   The  researcher  who  is  interested 
in  estimating  the  parameters  for  prediction  purposes  usually  applies  the 
least  squares  regression  method.   The  least  squares  model  can  be  written 
as  follows: 

where  g '  =  (3  ,  g-,  ,  .  .  . ,  g  )  is  the  vector  of  parameter  estimates  and 
Y   is  the  predicted  value  of  the  dependent  variable  for  the  particular 
set  of  iudeperKlent  variables  (X,  ,  X^^,    .  .  .,  X   )  observed. 

Before  utilizing  the  least  squares  prediction  model,  the  researcher 
often  wishes  to  make  inferences  about  the  components  of  P.   To  ensure  the 
validiLy  of  these  inferences,  the  following  assumptions  must  be  made: 

(1)   The  error  terms  (Z  's)  have  zero  mean  and   equal   variance. 


i.e.  ,  Z  -    (0,0-^) 


f2; 
(2)   If  the  independent  variables  in  the  model  are  randcn,  then  the 

1 


error  terms  are  distributed  independently  of  these  independent 
variables,  i.e.,  Z   is  distributed  independently  of  the  X  's. 

(3)   Successive  errors  are  uncorrelated. 

When  autoregressive  schemes  or  stochastic  difference  equations  are 
used  in  the  regression  model,  lagged  values  of  the  dependent  variable 
occur  as  independent  variables.   These  types  of  models  violate  assumption 
(2),  and  will  be  excluded  from  further  consideration  in  this  research. 
For  models  which  do  not  contain  lagged  values  of  the  dependent  variables 
as  regressors,  the  independent  variables  can  be  regarded  as  fixed,  known 
constants,  even  if  they  are  in  fact  random  variables.   All  inferences  are 
then  conditional  on  the  observed  values  of  the  independent  variables. 
Of  importance,  then,  is  determining  whether  the  model  under  consideration 
is  in  violation  of  assumption  (3).   Wien  this  assumption  is  violated,  as 
is  often  the  case  in  the  analysis  of  time  series  data  and  in  econometric 
modeling,  complications  arise.   In  order  to  grasp  the  severity  of  the 
problem,  let  us  consider  the  following: 

Re.nrite  the  regression  m.odel  (1.1.1)  in  matrix  form  as 

Y,   T,  =  X,    ,  B,      ,)   +   Z,      ^.^      .  (1.1.2) 

.(nxl)     (nxg)  .(gxl'    .(nxl) 

Let  us  write  assumption  (3)  as  Z  ~  (0,0^1),  or,  more  strongly,  Z  ~  N(0,a2l) 
Then  E(Y)  =  Xp  and  E{ (Y-Xg) (Y-Xg) ' }  =  o^I.   Applying  the  method  of  maximum 
liI:clxhoGd  to  the  density  of  Y,  the  least  squares  estimates  of  the  unknown 
model  parameters  (S)  are  obtained  and  are  given  by  the  well-known  formula 
&  =  (X'X)~  X'Y.   Under  the  assumption  that  Z  "  ^(Q,a^l),    the  vector  g  has 
the  following  properties: 

(a)  L(3)    =  3 

(b)  E{(S-3)(B-B)'>  =a?-(X'X)"^ 


(c)  B  is  the  BLUE  (best  linear  unbiased  estimator)  for  B  (Gauss- 
Markov  Theorem) . 

(d)  3  has  minimum  variance  among  all  LUE  for  3  (Gauss-Markov 
Theorem) . 

(e)  6  is  a  maximum  likelihood  estimate. 

(f)  6  -'  N{3,  a2(X'X)"l} 

Suppose  now,  that  assumption  (3)  is  violated  and  that  Z'~    N{0,Z}, 
where  E  =  o'-^',  T  a  general  covariance  matrix.   Then  E(Y)  =  XB  and 
E{  (Y-X3)  (Y-Xg) '}  =  Z  =  o^'F.   In  order  to  obtain  estimates  of  the  elements 
of  B,  the  maximum  likelihood  procedure  is  again  applied  to  the  density  of 
Y.   This  yields  the  estimator  B  =  (X'4'~^X)~^X'4'~^Y,  sometimes  called  the 
Markov  estimator.   From  the  Gauss-Markov  Theorem,  it  can  be  shown  that 
B  is  the  BLUE  for  B  and  that  B  has  minimum  variance  (a^(X'¥  ^X)  ^)  among 
all  LUE  for  B.   Let  us  consider  the  plight  of  the  researcher  who  (in  place 
of  the  more  general  Markov  estimator)   utilizes  the  usual  least  squares 
estimate  of  6,  say  g  ,  in  the  presence  of  dependent  errors.   Only  if  the 
characteristic  vectors  of  T  have  a  specific  form,  does  B,  equal  B  [4]. 
However,  this  is  usually  not  the  case  in  any  practical  situation.   Assuming 
that  the  two  estimators  are  unequal,  the  vector   B,  has  the  following 
properties: 


(a)   E(3j^)  =  B 


(b)  E{(B^-§)(§^B)'}   =  (X'X)  ^X'ZX(X'X)  1  =  a2(X'X)  ^X'V  X(X'X)  ^ 

(c)  Bj  no  longer  has  m.inimum  variance  among  all  LUE  for  B 

(d)  B^  is  no  longer  a  maximum  likelihood  estimator 

(e)  B^  -^  N  {B,  a2(X'X)~lx'VX(X'X)~^ 

The  Implication  of  properties  (b)  and  (e)  is  that  the  usual  least  squares 
fornula  foe  finding.  t?ie-  vari^ince  of  B-[,o^(X'X)  -^ ,  yields  a  biased  estimate 


of  tha  true  variance  E{(Bj^  -  0)'(3,  -3)}    =    a2(X'X)~^X'  X(X'X)~1. 

Tha  least  squares  test  statistics  used  for  making  inferences  about  the 

elc.i.ients  of  g  are  often  stochastically  larger  in  the  presence  of  dependent 

errors.   Thus,  the  researcher  will  tend  to  reject  the  null  hypothesis 

H  :  H   =0  more  often  than  he  should,  and  hence,  will  include  insignificant 
o   i 

terras  in  the  model. 

In  order  to  avoid  the  problems  introduced  by  applying  the  least  squares 
procedure  when  the  errors  are  dependent,  a  test  for  independence  in  the 
errors  (sometimes  called  a  test  for  serial  correlation  of  the  errors)  is 
essential . 

1.2  Various  Tests 

Since  the  errors  (Z)  of  a  least  squares  regression  are  not  observable, 
a  test  for  serial  correlation  of  the  errors  must  be  based  on  the  residuals 
(Z)  obtained  from  the  calculated  regression,  where  Z  =  Y  -  Xg .   However, 
in  most  cases  the  residuals  are  correlated  whether  the  errors  are  dependent 
or  not;  consequently,  ordinary  tests  of  independence  for  an  observed  se- 
quence of  random  variables  cannot  be  used  without  modification.   Many 
test  procedures  have  been  proposed  for  this  problem,  and  in  this  section 
a  summary  of  several  popular  tests  will  be  presented. 
1.2.1   The  Durbin-Watson  Test 

J.  Durbin  and  G.S.  Watson  [10]  in  1950-51  were  among  the  first  to 
consider  the  problem  of  testing  for  serial  correlation  of  the  errors  in 
least  squares  regression,  and  their  test  and  its  modified  versions  remain 
tl.a  uost  widely  applied  tests  of  regression  error  independence.   In  order 
to  inva;3tigai;e  the  random  error  component  Z  in  the  model 

Y,   ,,  =  X,    nB,   -.^  +  Z,   T.  ,  (1.2.1) 

,(m:l)     (nxg).(gxl)    .  (nxl) 


I>arbin-Watson  (D-W)  make  the  usual  assumption  under  the  null  hypothesis: 
the  errors  are  independent  and  identically  distributed  normal  random 
variables  with  zero  mean  and  constant  variance,  i.e.,  Z   -  i.i.d  N(o,a^)» 
The  type  of  alternative  they  consider  is  one  for  which  the  vector  of 
random  errors,  Z,  is  stationary,  and  for  which  Cov{Z  ,Z   }  =  yih)    is 
exponentially  (or  geometrically)  decreasing  in  h.   A  convenient  model 
for  this  hypothesis  is  the  first  order  autoregressive  [AR(1) ]  model,  or 
as  it  is  sometimes  called,  the  stationary  Markov  process:  Z^   =  0Zj-_]^  +  Cj., 
where  [0!  <  1  and  e^  ~  i.i.d  N(o,a^)  independently  of  the  Z  's.   Thus, 
the  null  and  alternative  hypotheses  take  the  form: 

H^:  0  =  0   versus   H^:  0  7^  0   . 
The  test  statistic  derived  by  (D-W)  is  given  by: 

,V't-2t-l)' 
d  =  £Z± 

n  ^ 
I  z/ 
t=l  ^ 

where  Z  is  the  vector  of  residuals  from  the  calculated  least  squares  re- 
gression (Z  =  Y  -  X3)  . 

Durbin  and  Watson  derived  the  d  statistic  using  a  result  obtained  by 
T,W.  Anderson  [  5]  in  1948.   Anderson  showed  that  no  test  exists  which 
is  uniformly  most  powerful  against  the  two-sided  alternative.   However, 
for  cases  in  which  the  columns  of  the  X  (design)  matrix  in  the  model 
(called  'regression  vectors'  by  Anderson)  are  linear  combinations  of  the 

eigenvectors  (latent  vectors)  of  a  matrix  A  (where  A  occurs  in  the  density 

Z '  A  Z  /    > 

function  of  Z) ,  tests  based  on   -    ~   are  uniformly  most  powerful  (IfilP; 

*  ,  '• 
Z  Z 
a:;c-inpt  one-sideri  alternatives,  and~have  optimal  properties  for  two-sided 

alucrnacives.   The  density  functions  o^"  Z  which  lead  to  the  WfP  test  have 


have  been  shown  by  Anderson  to  take  the  form: 

f(Z:0,a2)  =  K  exp[{  (1+0)'^Z 'Z  -  20Z'A  Z}  "  (-  —-)]■  (1.2.2) 

~  ~     ~    ~       Zo^ 

tvfhen  the  distribution  of  Z  takes  the  form  of  the  AR(1)  mode?.,  the  density 
of  Z  can  be  written  as: 

f(Z:0,a2)==  K2exp[-  ^   {  (1+0)  2^Z^Z^2  _  02(2^2+^^2) 


-  20  Z  Z.Z.  ,}]  . 
t=2   ^"-^ 


(1.2.3) 


By  taking  Z'A  Z  =  E  (^^"^t-l^   ^"  equation  (1.2.2),  (D-W)  obtained  the 
density  function: 


f(Z:0,a2)  =  K3exp[-  -^(1+0)^  £  Z^^  "  0(2^2+  z^2) 

-  20j2Zt^t-l>  ]   '  (1-2.4) 

which  is  very  close  to  the  AR(1)  density  in  equation  (1.2.3).   Thus,  an 
appropriate  choice  of  A,  namely 


1-10 

-1     2   -1 

0-12 

0     0-1 


0    0 
0    0 


2  -1 
-1   1 


loads  to  a  d  statistic  which  provides  a  \Jh^'   test  against  one-sided 
alternatives  in  the  "latent  vector  case",  i.e.,  the  case  when  the  columns 
of  the  design  matrix  coincide  with  the  latent  vectors  of  A. 

The  d  statistic  is  bounded  balow  by  0  (obvious)  and  above  by  4.   In 
order  Lo  see  that  d  -  4,  expand  the  numerator  of  the  statistic: 


Then 


Now, 


hence 


,loJh-h-P'   =  th^h'-'^th-l^'-li^ 


t=2  t   t=2  t  t-1  t=2  t-1 


-  Z  Z,2_2  x  2  7   +  £  z2 
t=l  t   t=2  t  t-1  ^^j_   t 


d  =  ,|2(Z^-Z^_p2  -  2  -  2^E2Z,Z^_i 


t^l^ 


I    Z^Z   , 
t=2  ^  t-1  >  _^  ^ 

n 

t=i  t 


d  -  2[l-(-l)]  =  4 


tEl^ 


_  2  ZtZ^._3^ 
t=2 


t^l^ 


Thus,  if  the  errors  were  positively  serially  correlated,  e.g.,  Z^.  =  ^^t-l 
+  £  ,  0  >  0,  d  would  tend  to  be  relatively  small,  and  if  the  errors  were 
negatively  serially  correlated,  e.g.,  Z^  =  0Z^_]^  +  e^,  0  <  0,  d  would 
tend  to  be  relatively  large.   The  user  of  the  d  test  interested  in  detecting 
the  existence  of  positive  serial  correlation  of  the  regression  errors  would 
reject  the  null  hypothesis  of  independent  errors  (0  =  0)  in  favor  of  the 
alternative  0  >  0  if  d  <  d",  where  d-  is  tlie  appropriate  critical  value 
of  d  for  a  lower-tailed  test.   Upper-tailed  tests  (tests  for  negative 
serial  correlation)  are  carried  out  in  a  similar  manner. 

A  major  drawback  to  this  testing  procedure  is  that  it  is  only  possible 
to  find  the  exact  null  distribution  of  d  in  very  special  cases  (see 
Anderson  [  5]),  cases  i«7hich  do  not  frequently  occur  in  practice.   However, 


D-W  show  that  it  is  possible  to  calculate  upper  (d-y*)  and  lower  (d^**) 
bounds  to  the  critical  value  d--,  v;here  0  -  dj^*<c^dy*  -  4.   Tabulated 
values  of  the  critical  bounds  are  made  available  in  Durbln  and  Watson 
[10].    The  procedure  for  conducting  a  test  designed  to  detect  the 
existence  of  positive  serial  correlation  is  as  follows: 

(a)  if  d  <  d-r*,    reject  H   (significant  at  level  a) 

(b)  if  d  >  d  ■",  do  not  reject  H^  (insignificant  at  level  a) 

(c)  if  d  "  <  d  <  d  *,  the  test  is  inconclusive. 

By  observing  that  the  null  distribution  of  d  is  symmetric,  with  0  -  d  -  4, 
a  test  for  negative  serial  correlation  can  be  carried  out  exactly  as 
above,  only  using  the  statistic  4-d.   Two-sided  tests  are  obtained  by 
cocibining  single  tail  areas,  using  a/2. 

VJhen  the  observed  value  of  d  falls  in  the  "region  of  ignorance", 
d  ''-"  <  d  <  dj'"^,  the  bounds  test  is  inconclusive.   It  is  here  that  D-W 
recoiiimend  applying  a  beta  approximation.   The  procedure  involves  transforming 
d  so  that  its  range  is  (0,1),  accomplished  by  the  simple  transfoi-matlon 
yd.   A  beta  distribution  with  the  same  mean  and  variance  of  d  is  then  fit 
using  the  method  of  moments.   Critical  values  of  -yd  are  found  from  Tables 
of  the  Incomplete  Beta  Function,  and  the  test  is  conducted  in  the  usual 
manner. 

Tests  for  che  case  in  which  the  errors  in  a  least  squares  regression 
follow  a  r.pecific  non-first  order  autoregressive  process  were  developed 
by  Peter  Schmidt  [29]  and  K.F.  Wallis  [34]  a^d  were  based  upon  the  work 
done  by  D-W.   Schmidt  considered  the  AR(2)  alternative:  Z^.  =  03^Z^_-,^  + 
0'jZ^_^  +   e^,  c      -  i.i.d(o,a^).   A  test  of  the  null  hypothesis  H^:  0j  =  02  =  0 
is  carried  out  by  considering  a  generalization  of  the  D-W  d  statistic: 


d. 


2 


n     '-     ^  2  n  '^   " 


t=l  ^ 
When  analyzing  quarterly  data,  Wallis  argued  that  researchers  may  be 

interested  in  detecting  the  existence  of  seasonal  variation  of  the  error 

terms.   One  possible  seasonal  error  model  is  the  AR(4)  process:  Z  = 

0Z   ,  +  e  ,  E   ■"  i.i.d(o,a^).   Wallis'  "seasonal  effects"  test  is  based 

upon  the  value  of  the  modified  D-W  statistic: 

t=l^t 
Critical  bounds  for  both  non-first  order  tests  have  been  tabulated  by 

their  respective  developers.   The  tests  are  conducted  in  exactly  the  same 

manner  as  the  D-W  bounds  test. 

1.2.2   Beta  Approximation 

H.  Theil  and  A.L.  Nagar  [33]  criticized  the  D-VJ  bounds  test  because 
of  its  inconclusive  region  (d,''S  d^"")  ,  and  fear  that  the  practical  re- 
search worker  may  interpret  "no  inference  possible"  as  equivalent  with 
"no  evidence  to  reject  the  null  hypothesis  of  independence."   This  results 
in  bias  in  the  sense  that  many  cases  of  positive  serial  correlation  will 
be  overlooked,  especially  when  the  inconclusive  region  is  ].arge.   This 
situation  occurs  when  the  number  of  observations  is  small  and  the  number 
of  independent  variables  in  the  model  is  large. 

The  Thell-Nagar  (T-N)  approach  is  to  fit  a  beta  distribution  immedi- 
at;^ly,  dispensing  with  finding  bounds  for  the  critical  value  of  d*. 
However  J  their  method  of  fitting  the  beta  distribution  differs  from  that 
used  by  D-W.   The  d  statistic  is  transformed  to  a  beta  (p,q)  variable 
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d-a 
in  the  range  (0,1)  by  considering  the  quantity  X  =    ,    ,  where  the 

range  of  d  is  (a,b).   The  parameters  p,  q,  a,  and  b  are  then  determined 
by  the  methods  of  moments,  using  the  first  four  moments  of  d.   The  first 
two  moments  of  d  are  used  to  find  expressions  for  a  and  b,  while  the 
third  and  fourth  moments  of  d  are  utilized  for  determining  p  and  q.   T-N 
simplify  the  necessary  calculations  considerably  by  ignoring  terms  of 
lower  order  in  the  moment  expressions. 

R.C.  Henshaw  [20]  also  considered  a  beta  approximation  to  the  distri- 
bution of  d.  However,  where  T-N  approximate  the  first  four  moments  of  d, 
Henshaw  uses  the  exact  moments  of  d  in  fitting  the  beta  distribution. 

The  transformation  X  =  . 1^1 is  used,  where  v^  and  v     are,  respectively, 

Vn_g-vi  1      n-g 

the  smallest  and  largest  latent  roots  of  (I-X(X'X)~^ X' )A.   The  parameters 
p,  q,  v-i,  V  _   are  then  found  by  the  method  of  moments. 

The  calculations  needed  in  Henshaw 's  test  are  much  more  extensive 
than  those  of  T-N.   However,  T-N  point  out  that  their  approximations  are 
good  only  when  "the  behavior  of  the  [independent]  variables  is  sufficiently 
smooth  in  the  sense  that  the  first  and  second  differences  are  small  compared 
V7ith  the  range  of  the  .  .  .  variable  itself." 
1.2.3   drj  Approximation 

For  polynomial  regression,  E.J.  Hannan  [17]  discovered  that  the  D-W 
upper  bounding  statistic,  d  ,  gives  a  very  good  approximation  to  the  true 
distribution  of  d.   Hannan' r.  reasoning  was  based  on  the  fact  that  the 
d,,  bound  is  attained  in  the  latent  vector  case,  i.e.,  when  the  g  columns 

u 

of  the  design  matrix  are  linear  combinations  of  the  g  latent  vectors 
vectors  associated  with  the  smallest  non-zero  latent  roots  of  the  matrix 
A-   Later,  Kannan  and  R.D.  Terrell  [IS]  showed  that  the  approximation 
reiraius  reasonably  good  whenever  the  coded  values  of  the  independent 
vi-rlabJes  are  concentrated  near  the  origin  (spectrum  of  the  independent 
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variables  in  the  model  is  concentrated  near  the  origin) ,  which  fre- 
quently occurs  for  economic  time  series. 

In  the  ]ight  of  Hannan's  work,  I>arbin  and  Watson  [12]  theorized  that 
the  shape  of  the  d  distribution  might  well  be  better  approximated  by  the 
distribution  of  the  upper  bounding  statistic  d  .   However,  D-W  felt  that 
this  approximate  distribution  should  have  the  same  mean  and  variance 
as  the  distribution  of  d  since  this  was  the  one  desirable  property  possessed 
by  the  beta  approximation.   The  statistic  d"  =  a  +  bd,,  was  considered; 
where  a  and  b  are  chosen  so  that  d"  has  the  samie  first  two  moments  as 
d.   Critical  values  of  d  ,  tabulated  by  D-W  in  their  1951  paper,  are  used 
in  finding  the  critical  values  of  d"  [11] . 
1.2.4   BLUS  Estimators 

It  can  be  shoi-m  that  the  covariance  matrix  for  the  residuals  is 

E(Z  Z')  -  o2{T-X(X'X)~^X'}  =  o^M. 
Thus,  even  if  the  null  hypothesis  is  true,  the  residuals  are,  in  general, 
correlated  and  heteroscadastic.   The  result  complicates  matters  considerably, 

as  evidenced  by  B-W's  upper  and  lower  bounds  to  the  significant  points 
of  d.   H.  Theil  [32]  reasoned  that  the  "testing  procedure  would  be  simpli- 
fied considerably  if  the  covariance  matrix  of  the  [residuals]  were  of  the 
form  o'^I  rather  than  a"M."   Theil  considered  new  estimates  of  the  regression 
errors,  called  BLUS  estimates;  that  is,  best  linear  unbiased  within  the 
clf.ss  of  tiiose  linear  unbiased  estimates  that  have  scaler  covariance 
matrix  c^I. 

The  new  regression  residuals,  V,  are  foriTied  such  that  E{  (V-Z)  '  (V-Z) } 
is  minimized  subject  to  E(V)  =  E(Z)  =  0  and  E(VV')  =  a^P„,  where  H  is 

chosen  npriori.   By  choosing  9,,        ,  as  a  diagonal  matrix  with  n-g  ones 

(nxn) 

and  g  zeroes  along  the  diagonal,  the  new  residuals  V   are  BLUS  estimators 
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of  Z.   Theil's  test  statistic  takes  the  form  of  D-W's  d  statistic,  only 
with  the  Z. 's  replaced  by  the  V  's: 

BLUS   -- — • 

t=l  t 

Now  the  BLUS  estimates,  under  the  null  hypothesis,  are  independent  with 
zero  mean  and  constant  variance,  hence,  the  exa^ ::  null  distribution  of 
dg^yjg  is  a  standard  one.   Critical  points  are  tabulated  by  B.I.  Hart  [19]. 

Theil  notes  that  the  choice  of  the  matrix  il   actually  results  in  a 
dropping  of  g  of  the  n  residuals  from  the  estimation  process.   This  proce- 
dure permits  any  set  of  g  residuals  to  be  dropped,  the  choice  being  left 
to  the  user.   However,  as  pointed  out  by  A.P.J.  Abrahamse  and  A.S.  Louter 
[  2],  there  exist  (  )  possible  BLUS  estimators,  each  of  v/hich  will, in 
general,  yield  a  different  result.   No  method  has  been  given  for  selecting 
the  optimal  vector  of  BLUS  estimators. 

Abrahamse  and  Louter  (A-L)  hypothesize  that  a  diagonal  matrix  n   is 
not  a  necessary  condition  to  eliminate  the  inconclusive  region  in  the 
D-W  bounds  test.   It  is  sufficient  to  require  that  fi  does  not  depend  on 
the  design  matrix.   The  estimators  of  A-L  are  derived  in  the  same  manner 
as  the  BLUS  estimators  with  the  modification  that  a^Q=   a'^KK'  approximates 
a^M,  and  the  test  statistic,  like  Theil's,  takes  the  form: 

"  (V  -V   )2 
n  ^  2 

til  t 

A-L  show  that  the  Q  statistic  has  the  same  distribution  as  the  D-W  upper 
bounding  statistic  d  .   Hence,  it  is  an  exact  test,  with  tables  available 
for  finding  significance  points. 
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The  procedures  developed  by  Theil  and  A-L  both  necessitate  tedious 
calculations  in  order  to  obtain  residual  estimates.   G.D.A.  Phillips  and 
A.C.  Harvey  [26]  sought  to  simplify  the  calculations  and  interpretations 
of  the  estimated  residuals,  while  retaining  the  properties  of  the  BLUS 
estimates.   They  determined  that  this  could  be  accomplished  by  utilizing 
"recursive  residuals."   One  normally  estimates  the  model  parameters  on 
the  basis  of  all  n  observations.   The  recursive  residuals,  denoted  by 
Z.,  are  found  by  using  only  the  first  j  observations,  j=g+l,  g+2,  .  .  ., 
n.   These  residuals  can  be  easily  generated  by  a  recursive  algorithm. 
The  Phillips  and  Harvey  (P-H)  test  statistic  takes  the  familiar  form: 

.2 


d  =  t^R+2 


.1.'- 


Z. 


Under  H^jthe  {Z  }  are  distributed  independently  with  zero  mean  and  constant 
variance.   Critical  values  of  this  standard  distri-bution  have  been  tabu- 
lated by  Hart  [19].   Like  Theil's  BLUS  estimators,  the  recursive  residuals 
are  linear,  unbiased,  and  possess  a  scaler  covariance  matrix. 
1.2.5  The  Sign  Test 

One  of  the  first  researchers  to  consider  a  non-parametric  alternative 
to  the  D-Q  bounds  test  was  R.C.  Geary  [14].   Geary  found  that  a  simple 
count  of  the  number  of  sign  changes  in  the  least  squares  residuals  could 
be  used  as  a  test  for  serial  correlation  in  the  errors.   If  the  errors 
are  independent,  the  signs  (plus  or  minus)  of  the  residuals  in  the  se- 
quence v/ill  occur  in  random  order.   Serial  correlation  is  inferred  then, 
if  the  number  of  sign  changes  are  fewer  than  expected. 

Let  n  bs  the  number  of  observations  and  t  the  number  of  sign  changes 
in  the.  sequence  of  residuals.   Then  under  the  null  hypothesis  of 
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Independence,  t  has  the  distribution: 


p(0  =^2zi) 


T ! (n-l-T ) ! 


Thus,  it  is  possible  to  calculate  significance  points  of  x  under  H  .   The 
hypothesis  of  white  noise  is  rejected  when  x  <  x*,  where  x*  is  the  tabulated 
significance  point  for  the  values  of  n  and  a. 

Geary  notes  that  the  x-test  is  very  similar  to  the  familiar  rxms 
test.   In  fact,  the  number  of  runs,  U,  is  one  more  than  the  number  of 
sign  changes,  x,  i.e.,  U  =  x  +  1.   In  runs  theory,  the  number  of  plus 
and  minus  signs  are  taken  into  account,  whereas  these  are  ignored  in  the 
sign  test.   Geary  remarks  that  the  sign  test  is  a  handy  tool  for  assessing 
the  probable  presence  of  serial  correlation  for  those  workers  in  multi- 
variate regression  time  series  ^^:ho  are  computerless,  or  without  the  Durbin- 
Watson  routine  in  their  computer. 
1.2.6  Periodogram  Based  Tests 

Recall  that  D-W's  1950  d  test  was  designed  to  have  high  power  against 
only  a  first  order  autoregressive  alternative  error  model.   However,  the 
nature  of  the  residual  dependence,  when  it  exists,  may  be  m.ore  general 
(non-first  order).   Thus,  an  investigator  may  wish  to  obtain  a  more 
comprehensive  picture  of  the  departure  from  serial  independence  than  is 
provided  by  a  single  statistic  like  d.  Durbin  [  9]  suggests  that  it  may 
be  more  appropriate  to  ask  what  the  data  reveals  about  the  departure  from 
serial  independence  rather  than  to  set  up  a  particular  parameuric  alter- 
native and  seek  a  test  vjhich  has  high  pox^7er  against  it.   Durbin 's  1959 
technique  for  studying  the  general  nature  of  the  serial  dependence  in  a 
stationacy  series  of  observations  Z^ ,  Z  ,  .  .  .,  Z   is  to  compute  the 
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^  P  /  '"  P    ,  r  =  1,  2,  3, 
„     Z^  r  Z,  r 
S  .  =  r=l   r=l 
J 


^.=1 


T     (2.irt)/T 
t=l  ^ 


and  then  to  make  a  plot  of  S.  versus  j/m.   This  plot  is  called  the  cumu- 
lated periodogram,  S.  is  its  sample  path,  and  r  =  1,  2,  .  .  .,  m  the 
periodogram  ordinates. 

It  is  known  that  when  Z^ ,  Z„,  .  .  .,  Z  are  independent  and  identically 
distributed,  the  sample  path  S,  behaves  asymptotically  like  that  of  the 
sample  distribution  function  in  the  theory  of  order  statistics.   Hence, 
the  Kolmogorov-Smirnov  limits  can  be  applied  to  provide  a  test  of  serial 
independence.   However,  when  the  periodogram  is  computed  from  the  least 
squares  residuals  (Z  ) ,  modifications  to  this  procedure  are  necessary, 
since  the  residuals  themselves  are  correlated  in  any  case. 

For  a  test  against  positive  serial  correlation,  a  critical  value  C 

or  Q 

for  the  Kolmogorov-Smirnov  statistic  is  acquired  from  available  tables. 

Like  the  D-W  bounds  procedure,  there  are  three  regions  for  the  sample 

path  of  S . : 
J 

(1)  If  the  sample  path  of  S.  crosses  an  upper  line  C  +  j/m.', 

reiect  H  . 
o 

(2)  If  the  sample  path  of  S.  fails  to  cross  a  lower  line  C  -h 
[j  ~  ^(S~l)]/ni'>  do  not  reject  H   (where  --g  -  y  -  j  -  m  and 
m'  =  ^(n-g)). 

(3)  If  the  sample  path  crosses  nei.ther  the  lower  or  upper  line, 

the  test  is  inconclusive  (analagous  to  the  inconclusive  region 
for  the  D-W  bounds  test) . 
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Diirbin  notes  that  this  technique  is  conservative  in  the  sense  that,  for 
a  test  of  significance  level  a,  the  probability  of  falsely  rejecting  the 
null  hypothesis  does  not  exceed  a.   Tests  against  negative  serial  cor- 
relation are  carried  out  similarly,  and  a  two-sided  test  may  be  obtained 
by  applying  both  one-sided  regions  at  significance  level  a/2. 
1.3  Concluding  Note 
We  have  presented  a  brief  summary  of  available  tests  for  serial 
correlation  of  the  errors  in  a  regression  analysis.   The  properties  of 
these  tests  are  discussed,  and  comparisons  made,  in  the  chapter  that 
follows.   In  particular,  we  are  concerned  with  the  performance  of  these 
tests  in  the  presence  of  non-first  order  serially  correlated  errors. 


CHAPTER  II 
COMPARING  TESTS  OF  SERIAL  CORRELATION 

2.1   Power  Comparisons 

Many  researchers  have  conducted  Monte  Carlo  and  simulation  studies 
in  order  to  estimate  the  powers  cf  the  various  tests  for  serial  inde- 
pendence.  Most  of  the  power  studies  in  the  literature  focus  on  the 
Durbin-Watson  d  test.   In  the  following  sections,  the  d  test  is  compared 
to  three  groups  of  alternative  tests  and  a  brief  summary  of  the  results 
is  presented. 
2.1.1   Exact  d  Test  Versus  Approximate  Tests  of  Serial  Correlation 

In  1971,  Durbin  and  Watson  [12]  investigated  and  compared  the  exact 
distribution  of  d  with  certain  approximate  tests  which  were  developed 
using  their  procedure  as  a  basis.   These  include  the  Durbin-Watson, 
Theil-Nagar,  and  Henshaw  beta  approximations  and  the  Hannan  dy  and  Durbin- 
Watson  a+bd   approximations. 

Letting  d'  denote  a  random  variable  having  a  distribution  used  as  an 
approximation  to  the  true  distribution  of  d,  D-W  computed  P(d'-d^)  for 
each  approximating  distribution,  where  P  (d  -d  )=  a.   The  power  comparison.s 
reveal  that  the  tests  fall  into  three  categories:   Theil-Nagar  beta  and 
Hannon  d„;  D-W  beta  and  D-W  a+bd^;  Henshaw  beta.   These  groups  are  given 
in  increasing  order  of  accuracy,  which  coincides  with  increasing  difficulty 
of  calculation. 
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As  a  result  of  their  research,  D-VJ  make  the  following  recommendation: 
when  a  test  for  serial  correlation  based  on  the  least  squares  residuals 
is  required,  the  D-W  d  test  should  be  applied  first.   If  the  result  is 
inconclusive,  apply  the  D-W  beta  or  a+bd„  approximation,   l-rhen  special 
accuracy  is  needed,  use  the  Henshaw  beta  approximation.   Finally,  j.f 
a  more  comprehensive  picture  of  the  serial  properties  of  the  errors  is 
desired  than  is  provided  by  the  value  of  a  single  statistic,  employ  the 
cumulated  periodogram  method. 
2.1.2  d  Test  Versus  BLUS  Test 

Abrahamse  and  Koerts  [  1]  calculated  the  power  of  the  BLUS  test  for 
various  values  of  n  and  g  (number  of  independent  variables)  with  the 
parameter  of  the  alternative  error  hypothesis  at  a  relatively  large  value 
of  0  =  .8.   This  was  compared  with  the  following  three  quantities: 

(a)  P(d<dL"|H3),  called  the  probability  of  a  correct  decision  for 
the  d  test,  where  d^ *  is  the  lower  critical  bound  for  d, 

(b)  P(d>dy"|Hg),  called  the  probability  of  an  incorrect  decision 
for  the  d  test,  where  d^^-  is  the  upper  critical  bound  for  d, 

(c)  P(d<d*lH^),  called  the  power  of  the  d  test,  where  d*  is  the 
approximate  true  significance  point  of  d  obtained  by  using  a 
method  similar  to  those  discussed  in  Chapter  I. 

Note  that  the  probability  of  a  correct  decision,  as  defined  by  Abrahamse 
and  Koerts,  is  the  power  of  the  d  test  when  using  D-W's  bounds. 
The  results  obtained  by  A-K  can  be  summarized  as  follows: 
(1)   The  power  of  the  d  test  generally  exceeds  the  power  of  the  BLUS 
test. 

(ii)  The  pov/er  of  the  BLUS  test  dominates  the  probability  of  a  correct 
decision  for  the  d  test.   The  smaller  the  number  of  degrees  of  freedom 


19 


(n-g) ,  the  greater  the  difference. 

(iii)   The  power  of  the  BLUS  test,  the  probability  of  a  correct 
decision  and  the  power  of  the  d  test  converge  as  n-g  increases,  for 
in  this  case  the  inconclusive  region  of  the  d  test  disappears. 
Since  calculation  of  approximate  significance  points  for  the  d  test 
may  require  many  more  computations  than  the  BLUS  procedure,  A-K  recommend 
one  follow  the  schematic  shoxm  in  Figure  2.1.1  when  choosing  a  test  for 
residual  correlation. 


n-g  large 


.BLUS 


Durbin-Watson  d 


,BLUS 
n-g  sraalK!^  ^BLUS 

^Durbin-Watson  d if  inconclusive' 


approximate 
methods 


FIGURE  2.1.1 
ABRAIDMISE-KOERTS  CHOICE  OF  A  TEST  FOR  SERIAL  CORRELATION 

1- 1 • 3   The  Durbin-Watson  d  Test  Versus  Non-First  Order  Alternative  Tests 
V.  Kerry  Smith  [30]  compared  the  approximate  power  of  four  tests  for 
serial  correlation  with  t\ro  sets  of  alternatives:   second  order  auto- 
regressive  processes,  denoted  AR(2) ,  and     first  order  moving  average 
processes,  denoted  MA(1) .   The  four  tests  considered  in  the  study  were 
the  D-W  d  test,  the  Durbin  cumulated  periodogram  (S.)  test,  the  Schmidt 
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(dz)  test  and  the  Geary  (t)  count  of  signs  change  test.   Smith's  Konte 
Carlo  results  are  summarized  as  follows: 

(a)  For  the  MA(1)  error  model,  the  d  test  proved  to  be  consistently 
more  powerful  than  the  other  procedures.   However,  with  small 
samples  and  low  first  order  correlation  coefficients,  the 
differences  in  the  tests  are  not  pronounced. 

(b)  For  the  AR(2)  error  model,  three  main  results  are  obtained, 
(i)   For  certain  values  of  0-,  and  02  in  the  AR(2)  model,  the 

d  test  is  more  powerful  than  the  d2  test.   The  t  test  is 
shown  to  be  much  inferior  to  the  d. 
(ii)  In  models  with  large  and  approximately  equal  values  of  0^ 
and  02  the  d2  test  appears  to  become  more  powerful  than 
the  others.   (Large  0-.  and  0^  imply  first  and  second  order 
autocorrelations  near  1.   For  a  detailed  discussion  of  auto- 
correlation, see  Section  3.3.1.) 
(iii)The  S.  test  appears  to  be  at  least  as  powerful  as  the 

d  test  for  most  of  the  values  of  0-,  and  0„  considered  by 
Smith.   However,  the  S.  test  does  not  perform  as  well  as 
the  d„  test  in  most  instances. 
2.2   The  Alternative  Error  Model 
Almost  all  of  the  tests  discussed  in  Section  1.2  consider  only  a  first 
order  autoi'egressive  hypothesis,  i.e.,  one  in  which  the  hypothesized 
error  model  under  H   takes  the  form 

Zt  =  0Z^_i  +  e^, 

whf.re  {e^}"i.i.d.  (0,a^)  independently  of  {Z  }.   The  primary  reason  for 
this  restrictive  hypothesis  is. that  the  distributions  of  the  test  statistic: 
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aro  complex,  even  in  this  simple  case.   However,  many  time  series  exhibit 
autocorrelation  patterns  wl'ich  are  not  v/ell  iiiodeled  by  the  first  order 
model.   When  analyzing,  quarterly  residuals,  it  may  be  more  appropriate 
to  consider  the  model 

where  {g  }   is  defined  as  above.   The  performance  of  the  Durbin-Watson 
d  or  similar  test  should  be  evaluated  for  models  like  these. 

In  the  sections  that  follow,  v/e  will  examine  the  properties  of  tests 
designed  for  the  general  alternative  autoregressive-moving  average 
(ARI-LA.)  model 

\  +  ^\-i  ■"  H\-i  +  •  •  •  Vt-p  =  ^  ■"  'i  t-1 

+  «2  t-2  -^  •  •  •  ^  Vt-q- 


CHAPTER  III 
TOO  TESTS  DESIGNED  TO  DETECT  A  GENERAL  ALTERNATIVE 

3.1  Box  and  Pierce  "Portmanteau"  Test 

G.E.P.  Box  and  D.A.  Pierce  [  7]  developed  a  method  for  checking  the 
adequacy  of  fit  in  autoregressive-moving  average  (ARMA)  time  series  models. 
Finding  a  test  for  serial  independence  of  the  errors  in  least  squares 
regression  was  not  of  prime  importance  to  Box  and  Pierce  (B-P) .   However, 
they  did  discover  that  the  statistic  used  for  checking  model  adequacy  is, 
under  certain  conditions,  very  nearly  equivalent  to  the  D-W  d  test. 

Consider  the  general  ARMA  (p,q)  model: 

P         q 
Z  =  ^  0.Z,  .  +   ^  Gi^t-i  +  ^t'   t  =  1,2,.  .  .,  n      (3.1.1) 

where  the  {a  }  are  independent  unobservable  random  variables,  and  the 
vector  of  model  parameters  (0^,  02,-  •  •,  0  >  Qj,  ^2'    '    '    "'  ^n^ '  ^^ 
unknow.i.   In  order  for  (3.1.1)  to  attain  stationarity,  the  autorcgressive 
parameters  (0-,,  0^,  .  .  .,  0  )  must  satisfy  certain  constraints.   Fuller 
[13],  and  others  show  that  the  condition  of  stationarity  is  met  if  the 
roots  of  thr.  equation  x^  +  0^xP~l  +  02^^"  +  •  •  .  +  0p  =  0  are  all  in 
the  unit  circle.   To  guarantee  the  invertibility  of  the  moving  average 
part  of  aicdel  (3.1.1),  Fuller  states  that  the  roots  of  the  equation 
y*^'  +  ©iY'^"'''  +  QoY^-"^  +  .  .  .  +  9  =0  must  also  lie  in  the  unit  circle. 
This  condition  on  (Q-^,    02,  •  •  •,  0  )  enables  the  researcher  to  express 
the  {Zm}  generated  from  the  MA  process. 


23 


q 

i=0  ^  t-i' 


as  an  AR  time  series, 


V  -  ^JaZ.     .   +   a^ 
t   j=i  J  t-j     t 


(We  utilize  this  invertibility  property  later  in  Section  3.3.)   Through- 
out, then,  we  assume  that  model  (3.1.1)  is  stationary  and  invertible, 
i.e.,  the  roots  of  the  equations 


cP  +  0j^xP~^  +  02^^"^  +  •  • 


+  0=0 
P 


and 


y<l  +  G^y'^"^  +  92y^~^  +  .  .  .  +  9  =0 


are  all  in  the  unit  circle. 

After  calculating  the  parameter  estimates,  0-^,    02,  .  .  .,  0  ,  9-j^, 
Gt,  .  .  . ,  9  ,  by  the  usual  time  series  methods  (see  Box-Jenkins  [  8]), 
the  researcher  may  then  be  interested  in  checking  the  adequacy  of  the 
model: 

^t  =  J/j^t-j  +  Ji^iVl  +  ^t   •  (3.1.2) 

B-P  proposed  that  the  first  K.  sample  autocorrelations  of  the  residual 
series  {a  },  r^  ,  r^,  .  .  .,  rj^,  be  used  for  this  purpose,  V7here  K  is 
small  relative  to  n,  and  where 


—   X 
^j  =  t-JH-l^f^t-j  ^    j  =  1,  2,  .  .  .,  K  .         (3.1.3) 
n 
t=l  t 


In  particulaT',  E— P  considered  the  statistic, 
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3=1  ^ 

However,  the  true  sample  autocorrelations  cannot  be  calculated  since  the 
{aj.}  in  (3.1.1)  are  unobservable.   In  order  to  proceed,  the  researcher 
may  apply  the  method  of  least  squares  to  (3.1.2),  to  obtain  the  residuals 
{a  }.   Replacing  the  {a  }  with  {a^}  in  (3.1.3),  estimates  of  the  first 
K  sample  autocorrelations  are  found,  i.e., 

n 

r.  =      a  a  _. 
J   t=j+l  ^   t-3   ^    j  =  1,  2,  .  .  .,  k.        (3.1.4) 

n  -  2 
t=l  t 

K 
The  statistic  Q  =n  J^  r^^  is  then  of  interest. 
j=l  J 

B-P  shows  that  Q  will,  to  a  close  approximation,  have  an  asymptotic 
X^ -distribution  with  K-p-q  degrees  of  freedom.   The  'portmanteau'  test 
for  checking  the  adequacy  of  any  ARMA  (p,q)  process  will  lead  to  a  rejection 
of  the  hypothesis  that  the  model  adequately  fits  the  data  if  Q  is  "too 
large",  where  Q  -  X^  ^^_^_^y 

Although  B-P  are  not  actually  considering  a  regression  model  in  which 
the  errors  are  to  be  tested  for  independence,  notice  that  if  p=q=0  in 
(3.1.1),  i.e.,  if  the  {Z^}  are  assumed  independent,  a  test  based  on 


-1=  (j2Vt-l>/(JiV)' 


is  very  nearly  equivalent  to  the  D-W  d  test.   This  fact  would  lead  one 
to  believe  that  the  'portmanteau'  test  may  have  applications  in  the  area 
of  testing  for  serial  independence  of  the  errors  in  a  regression  analysis. 
In  particular,  let  p  7^  0,  q  =  0,  in  (3.1.1).   The  model  then  takes  the 
f  orra : 
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^t  "  Mt-1  +  ^2^t-2  +  •  •  •  +  ^p^t-p  +  =t  '     (3.1.5) 

where  {e^}    are  independently  distributed.   If  we  let  {Z^.}  represent  the 
unobservable  errors  in  a  regression  model,  then  (3.1.5)  is  the  general 
autoregressive  alternative  error  model  discussed  in  Section  2.2.   Under 
the  null  hypothesis  of  white  noise,  p  =  0,  and  the  B-P  statistic  Q  is 
distributed   asymptotically   as   a  chi-square     random  variable  with 
K  degrees  of  freedom.   It  seems  reasonable  to  utilize  the  Q  statistic  in 
a  test  for  serial  correlation  of  the  {Z  }.   "Large"  values  of  Q  would 
lead  to  a  rejection  of  the  hypothesis  of  white  noise.   Further,  since 
the  form  of  (3.1.5)  is  more  general  than  the  alternative  model  considered 
by  D-W  and  others  (see  Section  1.2),  one  would  expect  the  'portmanteau' 
test  to  be  more  powerful  against  general  alternatives. 
3.2   A  New  Technique:   The  Max-X   Procedure 

Jairies  T.  McClave  [24]  considered  a  new  method  of  estimating  the  order 
of  autoregressive  time  series  models,  called  the  maximum  chi-square 
(max-X  )  technique.   As  was  the  case  with  B-P,  a  test  for  serial  cor- 
relation of  the  errors  in  a  regression  model  was  not  of  prime  importance 
in  McClave's  research.   However,,  after  developing  the  max-X   procedure, 
McClave  hypothesized  that  this  technique  could  also  be  used  as  a  test 
for  serial  cori'elation  of  the  regression  errors,  and  that  this  test  would 
have  high  power  against  general  alternatives. 

IIcGlave  considered  the  stationary  autoregressive  (AR)  model, 

\   =  Mt-1  +  f'2^_2  +  •  •  •  +  t\-m  -^  ^t   '       (^-^-^^ 

where  the  {e  lis  a  white  noise  process.   Call  model  (3.2.1)  a  p*- '  order 
subset  AR  model  with  maximum  lag  m  if  exactly  p  of  the  lag  coefficients 
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0   02'  •  •  •»  0   ^^^   nonzero,  0^^^  i=   0  and  0.  =  0,  ¥•  >  m.   The  re- 
searcher whose  ultimate  goiil  is  to  obtain  estimates  of  the  nonzero  lag 
coefficients  in  (3.2.1),  must  first  estimate  the  elements  of  the  parameter 
set  ©  ■-=  {p;  2^,   J2,  .  •  •,  jp}  ,  where  (j-,^,  J2,  •  •  .,  jp)  are  the 
lags  having  nonzero  coefficients.   The  initial  step  in  the  order  estima- 
tion process  is  the  application  of  the  'subset  autoregression  algorithm' 
developed  by  McClave  [24].   Subset  autoregression  enables  the  researcher 
to  generate  a  sequence  of  estimates  of  Qy,  say  S  =  { (ty,  >  Qi/2'   •  •  •» 
(h)  ,  },  where  (h)  =  {k;  j  ,  J2,  .  .  • »  J^^ •   Once  these  estimates  are 
obtained,  McClave  proposes  the  following  sequential  procedure  for  choosing 
the  order  from  S: 

1.  Compute  the  sequence  of  statistics  {M^,  M^^,  .  .  .,  M-^_-j^}  ,  where 

M^^  =  n(aj^2  _  o2.^^)/a^_j_^,  k  =  0,  1,  2,  .  .  .,  K-1,  a^^    is  the  residual 

variance  corresponding  to  the  model  with  parameter  estimates  CS/u'  ^'^^ 

a^    is  the  residual  variance  corresponding  to  the  model  with  parameter 
k+1       ^ 

estimates  ^H^i..  i  • 

2.  For  a  given  choice  of  a,  determine  C,  such  that  P^M^  >  C^   =  a, 

where  M   is  the  maximum  order  statistic  in  a  sequence  of  (K-k)  independent 
k 

X?  random  variables. 

3.  Choose  the  estimated  order,  p,  such  that 

p  =  {min  k:Mj^  -  C^,  0  -  k  -  K}  , 
and  thus  (h)  ==  ©-.   This  method  of  estimating  (h)  is  referred  to  as 
the  "ffiax-X2  technique." 

To  illustrate  the  application  of  the  max-X^  technique  in  tests  for 
serial  correlation,  consider  the  first  order  AR  model  with  nonzero  but 
nnkaow.i  lag  j  ■,  : 
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Z  =  0.  Z     +  e 
t    Ji  t-j^^    t 

where  the{e  }  is  white  noise.   The  hypotheses  of  interest  to  the  re- 
searcher who  is  attempting  to  detect  serial  correlation  in  {Z  }  are 
then 

Ho=  \   =  0 

H,  :  0.  i^   0. 
■^1 

Rewriting  H  and  H   in  terms  of  the  parameter  set  Qy  ,  we  have 
H  :  (h)  =  ^^0}  (white  noise) 


I^:  ®  =  {1;  j^}  , 


where  1  -  2\   -  K.   The  test  statistic  takes  the  form; 

2\ 


T  =  n 
o    ' 


ra^2  -  a^ 


^1 


where 


fT2=yZ^   =C,  and  o,      is  generic  for  the  estimated 
residual  variance  of  each  first  order  AR  model.   However,  McClave  has 
sho^.vTi  that  the  subset  algorithm,  when  applied  to  (3.2.2)  will  choose 
that  lag  j  ,  which  minimizes  a,^  over  all  first  order  models.   Hence, 
the  test  statistic  takes  the  form: 


/a   ^    -  min  a. 
M     -  max   T     =  n(      °  ^1 


Jl 


■S) 


nin  o  / 

Jl      1  / 


Now  :  2 .  ^  .-   ^  .    .  .   .,    .  th 


c,^^   =   C  (1-r.  ),  where  i-   is  the  i,    sample  autocorrelation  functic 
1     o^        2i  Jl        ^1 

Then, 
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M  =  n  . 


^o  -"^j-tc^(i-ii)] 


min[C  (1-r^  )] 
Jl  °    ^1 


C^  -  C  [1-max  r2  ] 


C  [l-nisix  r'l  ] 
°    Jl  -Jl 


(3.2.3) 


imax  r. 
Jl^l 
1-max  r^ 
Jl   J; 


In  equation  (3.2.3),  notice  that  M^  is  equivalent  to  the  statistic 

n-max  r.^  .   McClave  showed  that  T— ^  X,  ,  i.e.,  the  statistic 

T  converges  in  distribution  when  H   is  true  to  a  X^  random  variable 
o       ^  o 

with  1  degree  of  freedom.   It  follows  then,  that  under  the  hypothesis 

of  X'jhite  noise,  M  — >  M,  \jhere  M  is  distributed  as  maximum  order 

2 
statistic  from  a  sequence  of  K  independent  y.      random  variables.   Values 

of  the  test  statistic  "too  large"  will  lead  to  a  rejection  of  H^,  where 

"too  large"  is  determined  according  to  the  distribution  of  M. 

Let  us  compare  the  "max-X^"  statistic. 


n  max  r .   , 
iSj^K  J 

with  the  Box-Pierce  "portmanteau"  statistic, 

K   „ 
n  E  r.2  . 

j=l  J 

Both  statistics  are  based  on  the  vector  of  sample  autocorrelations,  r  = 
(r,,  r^.  .  .  .,  r,J'.  Models  (3.1.5)  and  (3.2.1)  both  take  the  form  of 
the  mo",:c  general  alternative  error  structure 
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which  gives  rise  to  the  plausibility  that  both  testing  procedures  attain 
high  power  against  non-first  order  alternatives.   The  similarities  between 
the  two  statistics  are  evident,  and  considering  the  fact  that  the  well-known 
B-P  procedure  has  been  in  the  literature  and  widely  used  since  1970, 
some  may  question  the  motivation  of  those  investigating  the  max-X   tech- 
nique as  a  test  for  serial  correlation.   Obtaining  an  answer  to  this 
query  is  the  goal  of  this  research.   As  a  partial  answer,  we  offer  the 
following:   the  max-X^  test  is  presented  as  an  alternative  testing 
procedure  to  those  researchers  concerned  with  studying  parsimonious 
models,  i.e.,  m.odels  with  few  nonzero  lag  parameters.   In  most  practical 
cases,  if  the  {Z,. }  are  in  fact  correlated,  a  minimum  number  of  the  lag 
parameters  (0  ,  0  ,  .  .  .,  0  )  in  model  (3.2.4)  are  nonzero.   Consider 
the  researcher  who  utilizes 

K   2 
j-1  3 

as  a  test  statistic.   We  will  discover  in  Section  3.3  that  knowledge  of 
the  sample  autocorrelation  vector  r  is  sufficient  for  calculation  of  the 
parameter  estimates  (0  ,  0„ ,  .  .  .,  0^^^) .   Then  the  researcher  is  essentially 
computing  estimates  of  lag  parameters  which  are  knoxra  to  be  zero  as  well 
as  estimates  of  those  nonzero  lag  parameters.   These  "zero"  estimates, 
of  course,  contribute  very  little  to  the  statistic 

^    2 
n  y  r  ."^ 

j=l  J 
Our  conjecture  is  that  a  predominance  of  small  r.'s  will  deflate  the  sum, 
resulting  in  a  failure  to  reject  the  null  hypothesis  of  white  noise  when 
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in  fact  several  of  the  true  autocorrelations  are  nonzero.   This,  in  turn, 
leads  to  an  invalid  implementation  of  the  least  squares  inferential 
techniques  (see  Section  1.1).   Our  goal  is  to  show  that,  in  many  cases, 

the  practical  research  worker  can  avoid  this  problem  by  employing  the 

2 
max-X'  procedure. 

Consideration  is  given  to  both  the  null  and  non-null  asymptotic 

distributions  of  the  test  statistics  in  the  following  section.   These 

results  become  the  foundation  for  the  power  comparisons  discussed  in 

Chapter  4. 

3.3  Asy-mptotic  Distribution  of  the  Test  Statistics 

3.3.1  Preliminaries 

Assume  that  Z, ,  Z„,  .  .  .,  Z  are  observations  generated  at  n  consecu- 
1        I  n 

tive  time  points  by  a  stationary  AR  model  of  order  p  with  lag  coefficients 
(0-^,  0^,  -  .  .,  0p),  i.e., 

Z,  =  0Zt_i  +  02V2+  •  •  •  +  Vt-p+^t' 
t  =  1,  2,  .  .  .,  n   ,  (3.3.1) 

where  {c^}  is  an  uncorrelated  series  with  mean  0  and  variance  a^ (white 
noise) .   Let 

^v  ^  ^^^t^t+v^   '   ^  =  °'  *1'  ^2,  .  .  . 

and 

n-lv! 


C  =  -    z   Z^Z^^i  ,,  V  =  0,  ±1,  ±2,  .  .  .,  ±(n-l). 


V 


represent  the  true  and  sample  autocovariance  functions,  respectively. 
Also,  let  p   =  Y~-^Y   and  r   =  C~"-'c  be  the  true  and  sample  autocorrelations 
of  order  v,  respectively.   Then  the  vector  of  lag  coefficients  0  =  (0-|^, 
0^,  .  .  .  ,  0  )  •'  is  estimated  by  0  =  (0.,  0^,-  •  ■  J>)'    J"  the  modified 
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Yule-Walker  equations: 


r0  =  r 


where  T  is  a  symmetric  pxp  matrix  given  by; 


r  = 


1 
^1 


r 

2    1 


-p-1 


p-1 
"p-2 
"p-3 


and  r  =  (r, ,  r  ,  .  .  .,  r  )'.   Also,  the  estimate  of  a^    is  given  by 
1   2  P 

o  2  =  c  [l-rTr]. 
P     ° 


3.3.2   General  Case 

Due  to  the  complexities  involved  with  obtaining  the  exact  distribu- 
tion of  the  two  test  statistics  of  interest,  this  research  will  consider 
the  large  sample  properties  of  the  tests.   Anderson  [  4],  Grenander  and 
Rosenblatt  [15],  Fuller  [13]  and  others  showed  that  the  asymptotic  joint 
distribution  of  the  first  K  sample  autocorrelations  is  multivariate  normal, 
although  Bartlett  [  6]  was  one  of  the  first  to  consider  the  form  of  the 
limiting  variance  of  the  sample  autocorrelation.   This  asymptotic  result, 
given  in  its  most  general  form  by  Anderson,  is  stated  in  the  lemma  that 
follows. 
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Lemina  1:   Let 


Z  =    ^  a  E 

t     j=_co  j  t-j 


where  {e  }  is  white  noise, 

t 


and 


J=_CO 


Define  the  quantity  P  ,  as 


■o  2 


where 


and  let 


P.  =  ^o~^\.  =  E^^-tZt-fv^/^^^t'^   ' 


_   Z    t  t-v 
^v  ^=v+l         ^   1  <  vl  K   . 
n 

I    Z.2 
t=l  '^ 

Then  /nCr-p)  5 ^>  N^{o,V}  ,  where  r  =  (r  ,  r  ,  .  .  .,  r  )', 

p  =  (p  ,  p  ,  .  .  •>  p  )'  and  V  =■-  (v   )  is  the  KxK  dispersion  matrix  of 
-12  K  ij 

the  limiting  distribution  whose  elements  are  given  by: 

v..  =  P  +  Po.  +  2o  2p  -  4p  P.   ,   1  -  i  -  K       (3.3.2) 
11    o    /I     i  o     i  1 

V   =  P    +  P.  .  +  2p.p.P   -  2o  P   -  2p.P. 
ij     i+j     i-J      1  J  o    •  i  j     3  1 

1  ^  j  <  i  <  K  .  (3.3.3) 
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Proof:   See  Anderson  [  4],  pp.  489-495.  Q 

Recall  the  invertibility  property  of  the  AR>IA  model  in  Section  3.1. 
Fuller  [13]  and  others  show  that  {Z  }  generated  from  the  AR  process 
given  by  (3.3.1)  can  be  expressed  as  an  infinite  moving  average  (MA)  of 
{e  },  i.e., 

t   j=0  -^ 
with  {a.}  absolutely  summable,  if  the  roots  of  the  equation 

xP  +  0,xP~^  -I-  0^xP"^  +  .  .  .  +  0  =0 
12  p 

are  all  in  the  unit  circle.   Since  model  (3.3.1)  is  stationary,  this 
condition  is  satisfied  and  thus  the  AR  process  is  just  a  special  case 
of  the  time  series  model  defined  in  Lemma  1.   However,  before  applying 
Lemma  1  to  obtain  the  asymptotic  distribution  of  the  Box-Pierce  and 
max-x^  test  statistic,  we  point  out  that  in  practice,  the  {Z^.}  in 
model  (3.3.1)  are  unknown.   Hence,  the  researcher,  unable  to  calculate 
the  sample  autocorrelations, 


-  =   ^   ^t^t-v       <   < 
"V   t=v+l  1  -  V  -  K 

t^l^t 


must,  instead,  calculate  the  estimated  sample  autocorrelations. 


<    < 

1  -  V  -  K 


E 

z  z 

t  t- 

-V 

t=v+l 

n 

2 

Z   Z 

t=l^ 
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\vTiere  {Z  }  are  the  residuals  computed  from  least  squares  regression. 
The  (r  }  are  used  in  place  of  {r  }  when  calculating  the  Box-Pierce  and 
max-x''  test  statistics.   Thus,  our  interest  lies  in  determining  the 
limiting  behavior  of  the  estimated  sample  autocorrelations,  (r^ ,  r  ,  .  .  . 

A  result  due  to  Anderson  [4],  formally  stated  in  Lemma  2,  shows  that 
under  certain  regularity  conditions  on  the  design  matrix  X  of  regression, 
the  limiting  distribution  of  the  sample  autocorrelations  defined  in  Lemma 
1  also  holds  for  autocorrelations  computed  using  the  residuals  (Z  }  cal- 
culated from  least  squares  regression. 

Lemma  2:    Let  Y  =  X8  +  Z  be  the  regression  model  given  in  equation 
(1.1.1),  where 

t   j=-c.  J   t-j 


.E   a.  < 
1=--'  J 


nd  Xv'here  '  ^    ->    is  white   noise  with  bounded  moments.      Let 


n-h 


n,,  .  y  T<-<  n  <      ■  < 

^j(^)    =    t=l"i,t+h   ^jt'      1-    ^-   g'    1   -   J    -    g 


whei 


^11  "21 

'l2  ^"22 


gl 


gn 


Given   that    t]i3   tollovjing   four   conditions    (Grenander's    condition)    hold; 
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(1)      a^'.(0) 


(2)        ^^"+1     ^     0 
a^,(0) 


a?.(h) 
(3)     -^ ->  p:.(h) 


* 


v/a^.(0)aj.(0) 


(4)      R(0)    is   nonsingular,   v>7here  R(h)   =    [p..(h)]    , 


ther 


*^(r  -  p)  -^ — >     Nj^     ^9'   V}    , 

where  p  and  V  are  defined  in  Lemma  1, 

;"  Z  Z  . 
I        t   t-j 

t=i+i  <  .  <  ,^ 

^j  =  -r:: —        -      i  -  j  -  k, 

^z^ 

t=i  t 

and  Z  =  Y  -  Xig  =  [I-X(X'X)~^X^]Y. 


Proof:   See  Anderson  [4]  ,  pg.  593.  [] 
In  order  to  simplify  notation,  let 


K 
,(BP)     Z 


r .  =  nr ' r 


and 

T^"^^  =  n  max   r?    . 
l^j^K   J 

The  asym,ptotic  null  and  non-null  distributions  of  T     and  T    are 

given  in  theorem  form.   As  a  consequence  of  Lemma  2,  the  results  stated 

throughout  the  remainder  of  this  chapter  may  also  be  applied  v/ith  T 

and  T    are  computed  from  least  square  residuals. 

Theorem  1:   Let  r  =  (r  ,  r  ,  .  .  .,  r  ) ''  be  the  vector  of  sample 

autocorrelations  generated  from  model  (3.3.1),  and  let  T     and  x 
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represent  the  Box-Pierce  and  max-X^  test  statistics,  respectively. 


Then 

Ho      K 
i.e.,  T     converges  in  distribution  \<ihcn   the  null  hypothesis  of  white 
noise  is  true  to  a  central  x^  random  variable  with  K  degrees  of  freedom, 
and 

Ho 
i.e.,  T^'"^  converges  in  distribution  Xvrhen  the  null  hypothesis  of  white 
noise  is  true  to  the  distribution  of  M,  where  M  represents  the  maximum 
order  statistic  from  a  sequence  of  K  independent  Xt  random  variables. 
Proof:   Under  the  null  hypothesis  of  white  noise,  {Z^,}  is  uncorrelated 
with  mean  0  and  variance  o^.   Without  loss  of  generality,  take  o^=   1. 
In  the  null  case,  we  have  then 

i  1        V  =  0 

0        V  =  1,  2,  .  .  .,  K 


V  =  0 

V  =  1,  2,  .  .  .,  K 

1       V  =  0 

0       V  =  1,  2,  .  .  .,  K 


Y.,  = 


and 


P  =i 

V 


Recall  that  (Z  }  in  the  stationary  AR  model  of  (3.3.1)  may  be  v/ritten 
t 

as  an  infinite  MA  process, 


t   j=0  J  t-j 

wh»re   the   (a   }    are   absoluLely   suiruaable.      Having   satisfied    the   conditions 
J 
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of  Lemma  1,  we  apply  equations  (3.3.2)  and  (3.3.3)  to  obtain 


1      i=j 

v..  ={  (1=1,2,.  .  .,  K),(j=l,2,.  .  .,  K) 

^J   "  0      i^2 


Hence,  by  Lemma  1: 

/n   r  ~—^      N„{0,I}  . 

Then  T^^^^  — ^  x5(0),  where  xlM        is  a  central  x'"^  random  variable 
Hq.     K  K 

with  K  degrees  of  freedom,  and  T^'^'^ ^  M,  where  M  Is  the  maximum  order 

Ho 

statistic  from  a  sequence  of  K  Independent  x?  random  variables.  Q 

(BP) 
We  now  proceed  to  find  the  appropriate  critical  values,  C     and 

C        ,   where: 

a 

^,(BP)    ,^(BP)^      _    ^ 
"o  a 


and 


P 


{^(m)    >    ^(m)j    ^    ^    _ 


,(BP)    ^      ,  „^^_      , 


It   Is    obvious    that   C  =   X         »   x^?hele   x  is   given  by 

a  K,a  K,a 

P{X^(0)    >   X^      }    =   a    . 
K  K,a 

In  order   to   find   C        ,    let   C^      -    c   and   observe    that: 


nr,^,   <    c} 


P{r»  max      r?  <    c}    =  P{nr?   <    c,    nr^   <    c,    .    . 
l<-j<-K      J  ^  2 

=-■  P{nr^   <    c}'P{nr^  <    c}---P(nr2   <    c} 
-L  2  K 

=  P{--v'c  </nr,    </cl'P{-/c  <    v^r^   <    /c}-''p(-v^<    v^r^,  <    vc] 
=    [P{-/c   <    Z  <     v^c}] 
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where  Z  is  a  normal  random  variable  with  mean  0  and  variance  1.   Then 

K 


implies 


1-a  =  [P{-/c  <  Z  <  /c}] 


(1-a)   =  P(-/c  <  Z  <  /c} 


where 


=  2$(/^)-l, 


Thus,  we  have  that 

The  two  procedures  for  testing  H„:{Z,_}  uncorrelated  versus  H.  :{Z  } 


correlated,  at  significance  level  a,  can  be  outlined  as  follows: 

1.  Box-Pierce  test:   reject  H^  in  favor  of  11-,  if  T^   -^  >  x^ 

~ -Jo  1  K,a 

2.  Max-x^  test:  reject  H^  in  favor  of  H-,  if 


,(nO,  f.-i^I^iiz^l/^^]  2  . 


In  order  to  compare  the  two  procedures  in  terms  of  power  (Chapter  A) , 
consideration  must  also  be  given  to  the  non-null  distributions  of  the  test 
statistics.   Hovzever,  the  asymptotic  distributions  of  T^^^^  and  T  ™  are 
not  so  easily  derived  when  the  {Z  }  are  dependent. 

Recall  that  v^(r  -  p)  — ~ — ->■  N„{0,V}  (Lemma  1).   Mien  the  alternative 
of  serial  correlation  is  true,  the  asymptotic  dispersion  matrix  V  has 
a  non-diagonal  form.   For  our  purposes,  we  write  that,  under  H  ,/n  r  ->.. 
Nj,{/n  p,V}  for  large  n,  where  ->'  means  "has  an  approximate  distribution," 
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and  p  and  V  are  determined  froin  the  expressions  given  in  Lemma  1.   A 
result  due  to  H.  Scheff e^[ 28] ,  given  hero  as  a  lemma,  enables  us  to 
express  the  Box-Pierce  statistic  T^   •'  as  a  linear  combination  of 
independent  non-central  x   random  variables.   Following  this  lemma, 
the  asymptotic  non-null  distribution  of  T^  ^    is  given  in  theorem  form. 

Lemma  3 :   Let  2^  =  (x-i,  x  ,  .  .  .,  x  )   be  a  column  random  vector 
which  follows  a  multivariate  normal  law  with  mean  vector  u  and  covariance 
matrix  E.   Consider  the  quadratic  form  Q  =  x'Ax,  where  A  is  a  KxK 
symmetrix  matrix.   Then  if  E  is  nonsingular,  Q  may  be  expressed  in  the 
form: 


1=1  ^     '-■I     ^ 


where  (Ai,  \    ,    .    .    . ,A  )  are  the  distinct  nonzero  eigenvalues  of  AE, 

(r-,,  Xjt    .  .  .,  rp)  their  respective  orders  of  multiplicity,  (6-1",  60 

.  .  .,  On^)  are  certain  linear  combinations  of  (y-i,  jjo*  •  •  •>  ^n^  ' 

and  the  (x  r  ^*^t^-^'-i  ^  sequence  of  independent  non-central  x   random 

variables  with  r^   degrees  of  freedom  and  non-centrality  parameter  6. 2. 

Proof:   See  Scheffe'  [28],  pp.  A18.  □ 

Theorem  2:   Let  r  =  (r-.,  r^,  .  .  .,  r^,)  '  be  the  vector  of  sample 

autocorrelations  generated  from  model  (3.3.1),  and  V  =  (v^^)  the 

symmetric  positive  definite  KxK  dispersion  matrix  of  the  asymptotic 

distribution  of  \^.   r.   Also,  let  V  =  XT',  T  a  lower  triangular  matrix, 

and  consider  the  statistic 

K 
T^^^^  =  n  E  r  2=  n(r'r). 
j=l  J      ~  - 

Then  we  can  v;rite,  for  large  n: 
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1=1  1  r^  1 
where  (1)  (A  ,  A  ,  .  .  .,A„)  are  the  distinct  nonzero  eigenvalues  of  V, 

1        /  A/ 

(11)  (m^ ,  m    .  .  .,  m  )  are  the  respective  orders  of  multiplicities 
for  the  eigenvalues, 

(111)  ^^Y^   (6.^)}    a  sequence  of  Independent  non-central  y^  random 
'^  m .   1   i=i     ' 

variables  with  m.  degrees  of  freedom  and  non-centrallty  para- 
meter 6.'^,  1  =  1 ,  2 ,  .  .  .  ,  J?., 
1 

(Iv)  6.2=  np'V"'T-{n  (— ^).(T'T-A  -I)}-!  ^p  ,  1  =  1,  2,  .  .  .  ,^  . 
s=l  A^-A^        s 

Proof:      From  Lemm.a   1,    we  have   /n"  r  -pN   {/rTpjV}      for   large  n. 
Let  x  =   /i7r,    y   =    /np,E    =V,    and   A  =   1    in  Lemma   3.      Then 

T^^^-^    =  n(r'r)    =    (/^r)'I    (/^  r)    =  x^A   x      , 
and    the   condltioiis   of   Lemma    3  are   satisfied.      Thus,    for   large  n, 

1 
where   A.,   m . ,    and   Xra-(^-^)    ^^^^  defined   by    (1),    (11),    and    (ill).      If  V 
is  positive  definite,    W.Y.    Tan    [31]    obtained   a   formula  useful   for   comput- 
ing  the   non-centrallty  parameters  {  6.^}: 

5.2  =  n  p'-V~^-T-E.-T~l-p  ,    (1  =  1,  2,  .  .  . ,1) , 

a 

where  V  =  TT-  and  E .  =   n_  (x.-A  )~1-(T'T-A  -I),  1=1,  2,  .  .  . ,   I . 

X    S=l    IS  s 

s/i 
This  Is  condition  (iv)  of  theorem,  and  thus  completes  the  proof.  [] 

By  Theorem  2,  the  asymptotic  distribution  of  T     is  found  by 
determining  the  distribution  of  a  weighted  sura  of  independent  non- 
central  V-  random  variables.   The  problem  is  not  an  easy  one,  but 
J.  P.  Imhoff  [23]  and  others  have  succeeded  in  deriving  an  exnression 
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for  the  distribution  of  the  quadratic  form  Q  (given  in  Lemma  4) ,  by 
means  of  an  inverstion  of  the  characteristic  function  of  Q.   These 
results  are  given  in  Section  3.3.3.2.1  and  later  applied  in  Chapter  4, 
where  we  seek  powers  of  the  test. 

Similarly,  the  asymptotic  non-null  distribution  of  the  max-x 
statistic,  T^    is  a  complex  one  as  described  in  the  following  theorem. 

Theorem  3:   Let  r  =  (r,,  r^,    •    •    •>  ^k^ '  ^^  ^^^   vector  of  the  sample 

autocorrelations  generated  from  model  (3.3.1),  and  let  T^  ''=  n-max  r.  • 

l^j%  ^ 
Then,  for  large  n,  t'^^-'is  approximately  distributed  as  the  maximum  order 

statistic  from  a  sequence  of  K  dependent  non-central  x^  random  variables, 
{v..-x?(<5i)}/\  with 

2 
(i)  non-centrality  parameters  given  by  6.  =    i   ,  1-i-K 

'   2vi. 
and 

(ii)  V.  .  =  P^  +  P2i  +  2pJPo  -  4p  .P.  ,    l^i^K  . 

Proof:   Again,  by  Lemma  1,  /n  r~Nj^{/n  p,  V]  for  large  n,  where  the 

elements  of  V=(v-j^O  are  found  from  equations  (3.3.2)  and  (3.3.3).   Hence, 

for  large  n,  the  marginal  distributions  of  {v'n'r,-}     can  be  approximated 

i=l 

by  a  sequence  of  K  dependent  normal  random  variables  with  means{/np^}. 

and  variances  {v   }    ,  respectively.   Now,  for  1-1-K,  vn  r.  ~  N{/n  p.,v--} 
ii  i=l  1         1   iL 


implies  that 

/n  ri 


/v.. 


^  .1 


nr-?-     ^  _^,    .      „    np 


2 


Thus,  we  have  that  — -—   ~  Xt(<^-)»  where  6t  = ;  or,  we  write, 

V^^       11  1     /Vj-i^ 


nr_ 


^  -  v..*X^(<5?),  l~i-K.   It  follows  that  T^"^^  =  inax(nr.2)  is  approximately 


ii  1   i  '  ll-<K  ^ 
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distributed  as  the  maximum  order  statistic  of  the  dependent  (since  v.  .7^0 

in  general)  sequence  {v..x?(6.)}.   .   Q 
il  J.   1   x  =  i 

The  complexity  of  the  distribution  derived  in  Theorem  3  makes  power 
computations  very  difficult.   In  Section  3.3.3.2.2,  this  problem  is  made 
somewhat  more  workable  by  considering  a  Taylor-series  expansion  of  the 
density  function  of  T 

In  the  sections  that  follow,  a  few  simple  alternative  error  models 
are  presented,  and  the  non-null  distributions  of  the  max-x   and  Box-Pierce 
statistics  are  discussed.   The  severity  of  the  distributional  problem, 
even  in  these  simple  cases,  will  be  illustrated. 
3.3.3  Special  Cases 

Recall  the  first  order  AR  alternative  error  model  considered  by 
Durbin-Watson  (Section  1.2.1).   Let  us  consider  a  more  general  form  of 
this  model, 

Z^  .  0Z^_j  +  c^  .  (3.3.4) 

where  t  =  1,  2,  .  .  .,  n  and  (e.)  a  white  noise  process.  In  the  termi- 
nology of  the  previous  sections,  we  call  model  (3.3.4)  a  first  order  AR 
model  with  maximum  (and  singleton)  lag  J,  v/here  J  is  unknoxra. 

Lemma  4 :   The  vector  of  true  autocorrelations,  d  =  (p, ,  P«,  •  •  •)'> 
for  model  (3.3.4)  are  calculated  as  follows: 


1   .  .  .    V  =  0 

0"  .  .  .    V  =  mJ;  m  -  1,  2,  3,  .  .  .         (3.3.5) 

0   ...    otherwise 


Pv=  < 


Pr^oof:   Recall  that  p,^  =  Y^/Yq,   v  -  1,  2,  3,  .  .  ..   Using  model  (3.3.4) 
we  v.'rite  for  v  =  1,  2,  .  .  . 
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Y,,   =  E{Z    -Z        }    =   E{0Z        Z^    ^  +  E^Z        } 
^  t      t-v  t-v   t-J  t   t-v 


=   ^^^^^t^\-(j_v)>     -^  ^^^t^-v> 


Now,    E{e^Z        }=   0   since   Z^        is   uncorrelated  with   e.       . t ,    e.       , ^ >    - 
t   t-v  t-v  t-v+-i-        t-v+z 


^t'    ^+1'    • 


Hence, 


Y      =   0-E{Z    -Z^     .  >   =   0-Y,  „    ,    (v  =    1,    2,    3,    .    .    .).    (3.3.6) 

V  t      t-(J-v)  J-v 

Immediately,  we  see  that  for  m  =  1,  2,  3,  .  .  ., 


'mJ 


0Y 


(m-l)J   ' 


and  thus. 


mJ 


(m-l)J   • 


Since  p  =  1,  it  follows  that  p  ,  =  0  ,  (m  =  1,  2,  3,  .  .  .).   Consider  now, 
those  autocorrelations  of  order  not  a  multiple  of  J.   Take  v  =  J-v  in 
equation  (3.3.6).   Then  y^   =  0Y  '>    but  also  Yy  =  0Y,   •   This  implies 
that  Yv  =  0^Yv'  for  V  =  1,  2,  3,  .  .  .,  J-1,  J+1,  .  .  .,  2J-1,  2J+1,  .  .  .. 
And  since  0  7^  0,  it  must  be  that  y  ~   ^   fo^  v^^mJ,  (m=l,  2,  3,  .  .  .). 
This  completes  the  proof.   Q 

The  vector  p,  given  in  equation  (3.3.5),  will  be  used  to  compute 
the  asymptotic  mean  vector  of  the  sample  autocorrelations  for  this  special 
case. 
Lemma  5:   For  the  model  (3.3.4),  the  quantities  {V  .)    v  =  1,  2,  .  .  ., 


defined  in  Lemma  1,  are  given  by; 
f 
1+0^ 


V  =  0 


P  ,  =<  0™[m+l-(m-l)02]      V  =  mJ,  (m  =  1,  2,  3,  .  .  .)  (3.3.7) 


otherwise 


A4 


Proof:   From  Lemma  1,  we  have  P   =   Z  n .p   .  ,  (v  =  0,  ±1,  ±2 ,  .  .  .) • 
First  let  v  =  0.   Then  we  have 


p„  =   j:  p?  =  p  +  2  Z  p?   . 


Applj'ing  the  results  from  Theorem  4,  we  obtain 


o        m=r  mJ        m=l 


Since 

V      ^         a 

E  a  =  -q 

i=l     1-a 

if  I a|  <1,  we  have 

,  02      1+02 

For  V  a  non-multiple  of  J  and  je(-o=,  o^)  ,  the  integers  j  and  v-j  cannot 

both  be  multiples  of  J  simultaneously.   It  follows  that  P^  =  0  for 

V  ?^  mJ ,  (m  =  1,  2,  .  .  .)•    To  find  the  quantities  Pt>  (m=l,  2,  .  .  .)> 
we  vnrite 


P,-    T.    p  .p    y    .=    .    T.    p  .  ^p  ,       ..  -, 


=  jL»PjJP(m-j)J  +  j^o^jJ  (m.-j)J  "^  j=m+lPjJP(m-j)J- 
Utilizing  the  results  in  Theorem  4,  we  have 

P   =   E  030'"'^^  +   E  0i0™~J  +   E   0J0J-^  .         (3.3.8) 
mJ   j=i         j=0         j=m+l 

Now  take  i=^j-m  in  the  last  summation  of  equation  (3.3.8)  and  simplify  to 
finallv  obtain: 
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P  ,  =  0'".J:,02J  +  (iiH-l)0'"  +  0""  Z  02i 
mJ     3=1  i=i 


20^  Z  02 J  +  (m+l)| 


=  20  (-j^)  +  (n^Di 


'[nrfl  -  (in-l)02]/(l-02).    Q 


We  now  proceed  to  find  the  structure  of  the  asymptotic  distribution 
of  the  sample  autocorrelations  for  this  special  case  using  the  results 
derived  in  Lemmas  4  and  5- 

Theorem  4 :   The  covariance  structure  for  the  asjonptotic  distribution 

of  the  first  K  sample  autocorrelations,  (^t,   r„,  .  .  .,  r  ),  from  model 

■^    ^  K 

(3.3.4),  is  given  by: 

^l+02-(2m+l)02"^+(2m-l)02^"^^^ 


l+02+(nrf-l)0"'-(m-l) 


1+0^ 
■1-0-^ 


.m+2 


V  =  mJ  (ra  =  1,  2,  3,  .  .  .) 

(3.3.9) 


mJ 


, J  even  (m  =  1,  3,  5, 
.  .  .) 


otherwise 


0  [m+l-(m-l)0^-] 
1-02 


v-|+V2=niJ  or  Vi-Vo  =  mJ 


but  not  both      (3.3.10) 
(m  =  1,  2,  3,  .  .  .) 

0"^[m+l-(m-l)02]+0^[£+l-(£-l)02]        v  ,v 
1-0 


1+  o=mJ (m=l, 2 ,3. 
W^J(ii=l,2,3. 


"''^  "2    \  0^-^  [m-£4-l  (m-&-l)  02  ]  -0^   [m-^-£+l-  (mf  g -1)  02  ] 


v^  =  mJ  (m  =  1,  2,  .  .  .) 
V2  =  £J  U  =  1,  2,  .  .  .) 

otherv/ise 
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Proof :   Recall  from  Lemma  1,  the  expression  for  the  asjinptotlc  variance 
of  the  V   order  sample  autocorrelation,  /n  r  : 

%v  =Po  +  P2v+  2p2p^  -  Ap^P^  .  (3.3.11) 

For   v?^  raJ,    we  have   p^=   0    (Lemma    4)    and  P      =  P^      =   0    (Lemjna    5),    thus 

1+02 
V        =  P     =  r. — zrj        (v7^mJ;m=l,    2,    3,    .    .    .) 

ra 
Now  consider  v  =  mJ.   Here  we  have  from  Lemmas  5  and  6,p   =  0  , 

^  0"rm+l-(m-l)02l 
V      1-02 

and 

p   ^  02"'[2m+l-(2m-l)02] 
2v       i_02 

We  then  can  write 

^   _  l±0i  ,  0'"'[2m+l-(2m-l)02]  ,  ,02™  f^\  _    ,0'°^[m+l-(m-l)  0^] 
^v  -  i_02        i_02  ^'^       VI-0V        1-02 

=  { 1+02+02" [-2m-l+0^(-l+2m)]}  /(i_02) 

=  {l+02-(2m+l)02™+(2m-l)02^'^-'--*)/(l-02),  (v  =mJ;  m  =  1,  2,  .  .  .) 

Because  of  the  term  P2   in  equation  (3.3.11),  we  must  also  consider  those 
orders  of  multiples  of  J/2,  when  J  is  an  even  integer,  i.e.,v  =  J/2,  3J/2, 
5J/2,  ....   Here  2v  becomes  an  odd  multiple  of  J,  thus  (from  Lemmas  4  and 
5) 

p   =  0,P,  =  0  and  P,,  =  P  ,  =  0"[m+l-(m-110il  ,  (,  =  1,  3 ,  5 _  .  . ) . 
V     '  V  2v    mJ      1-0- 

It  follows  that 


47 


^  1+02  _^  0°'rTn+l-(m-l)0-] 


1-W       1- 


«2 


1-0^^  2   1.  3,  5,  .  .  .). 

This  completes  the  proof  of  equation  (3.3.9). 

The  asymptotic  covariances  of  the  sample  autocorrelations  are  found 
in  a  similar  manner.   Rewriting  equation  (3.3.3)  from  Lemma  1,  we  have, 
for  large  n, 

-  'V^i'  (V,  ^  vp.  (3.3.12) 

These  computations  become  quite  involved,  for  now  we  must  consider  those 

values  of  V  ,  v„,  V-  +  V   or  v   -  v„  which  are  multiples  of  J.   The  result 
12    12     1    2 

is  obtained  in  a  straightforward  but  nontrivial  fashion  if  we  group  the 
possibilities  as  follows: 

a)  V   a  multiple  of  J,  but  v  a  nonraultiple  of  J. 

b)  V   a  multiple  of  J,  but  v  a  nonraultiple  of  J. 

c) '   V  +  V   a  multiple  of  J,  but  v   -  v   a  nonmultiple  of  J. 

d)  V   -  V-,  a  multiple  of  J,  but  v  +  v   a  nonmultiple  of  J. 

e)  Both  V  +  v^  and  v,  -  v„  multiples  of  J,  but  neither  v-, 

X    2      1    2  -■- 

nor  V   a  multiple  of  J. 

f)  Both  V,  and  v  multiples  of  J. 

1      2 

Notice  that  in  case  (a)  and  case  (b) ,  neither  v  +  v  nor  v^  -  v^  can 
be  a  multiple  of  J.  Hence,  each  of  the  quantities  summed  in  equation 
(3.3.12)  are  zero.   Thus, 

v-o  ,x)  =0  for  V   7^  mJ  or  v^  7^  mJ   (m.  =  1 ,  2 ,  3,  .  .  .) 
''l   2  1  2 
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For  case  (c)  ,  the  only  nonzero  term  in  (3.3.12)  is  P,,  +-^    .   Similarly, 

12 

for  case  (d) ,  the  only  nonzero  term  in  (3.3.12)  is  Py  _v  •   This  gives 
^      =  P    =  0'"[nH-l-(in-l)02]      ^^^  ^.^^g^  v,+v  =mJ 
or  V  -V  =mJ  but  not  both  (m  =  1,  2,  .  .  .)• 

Tfhen  the  orders  of  the  sample  autocorrelations  follow  the  pattern  in  case 
(e)  ,  only  the  terms  P^,+y   and  'Py^-^j     are  nonzero.   Hence, 

_  0"rmfl-(m-l)0^1  +  0^[£+l-(£-l)0^] 
''vi'V2  ~  ^mj^vj  1-02 

for  V  +v  =mJ  (m=  1,  2,  3,  .  .  .),  and  v-,-V2=0 

a=   1,    2,  3,  .  .  .). 
Finally,  we  consider  the  order  pattern  in  (f ) .   Both  v   and  V2  multiples 
of  J  imply  that  both  ^,+^.y   and  v  -v   are  multiples  of  J.   Thus,  none  of 
the  terms  summed  in  (3.3.12)  are  nonzero.   Utilizing  Theorems  4  and  5,  and  lettinj 
V  =mJ  and  v=lJ,   we  obtain: 

"vi,v2  =  P(m+-£)/^m-£)/'PmjP£/o-2P,jP,j-2P,/,„j 

^  0""^^mf£+l-(m+",-l)02]    0""^  [m-£+l-(m-£-l)  0^] 
~r=P  1-02 

+  20^^^^ 


20''  ''[R+1- (1-1)0']   _  20^+>-[m+l-(m-l)0-] 
1-02  1-02 

0"''"^[m-£+l-(m-&-l)02]  -  0'""'"''^  [m+£+l-(m+Z-l)  0^  ] 


This  completes  the  proof.      G 
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3.3.3.1.   Model  1:   The  Case  J=2,  K=2 

let  us  now  apply  these  results  to  model  (3. 3. A)  when  J=2 ,  i.e., 


Z  =  0Z   ^  +  e 
t     t-2    t 


Suppose  also  that  the  researcher  chooses  to  base  the  test  of 


(3.3.13) 


H  :  0  =  0 


H^:  0  ^  0 


on  the  first  two  sample  autocorrelations  r   and  r   (i.e.,  K=2) .   Call 
this  the  case  (J=2,  K=2) .   Applying  formulas  (3.3.9)  and  (3.3.10)  from 
Theorem  5,  we  obtain 

_  1+2^0^  _  (1+0)^ 
^11  -  i_02   -  i_02   . 


and 


"12  =  °- 


From  equation  (3.3.35),  we  obtain  p   =  0  and  p   =  0.   Thus,  we  have  that, 
as  n  tends  to  infinity,  the  vector  (/n  r,  ,  /n  r„  -  v'n  0)'  is  distributed 
asymptotically  normal  with  mean  vector  (0,0)'  and  dispersion  matrix 


(1+0)^ 
1-0  ^ 


1-5 


We  write: 
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(/n  r-j^,/n  r^)  '  ^   N 


(0,4  0)'  , 


(1+0)' 
1-0 

0 


,   (3.3.14) 


1-0' 


for  large  n. 

Corollary  1:   Under  the  alternative  error  model  given  in  equation  (3.3.13), 

the  Box-Pierce  statistic  T^^^^  =  nr^  +  nr 2 ,  is  asymptotically  distributed 

as  a  weighted  sum  of  independent  single  degree  of  freedom  chi-square  random 

variables: 


^^"'  =  -^  -xlCO)  .  (1-0)^.40.)  , 


where  X  = 


n202 


.Proof:   From  Theorem  2,  we  write  T^^^^  =  -Ia -yI    (6?),  where  the  [A  }, 

1-1  1  '"x   1  i 

{m^},  and{62}  are  defined  previously.   Since  V  is  a  diagonal  matrix, 
it  is  obvious  that  the  eigenvalues  of  V  are: 

(1+0)2 


^1  ~~TW 


and  X^   =   1-02 


with  corresponding  multiplicities  m^=l  and  m2=l.   In  order  to  determine 
6^   and  6^  we  utilize  (iv)  of  Theorem  2.   Now 

1 


and 


«'here 


1   V  X-,-A 


1  2 
1 


2   V  Xo-A 


2  -^1 


1+0 


(T'T-A^-I) 


(T'T-A  •!) 


(Recall  that  V=TT ' ) 


J 
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Hence,   we  have 


6^   =   n-p    V    ^TE^T    ^p 


=   n.(0,^^)'TE^T    Ip 
=  n.(0,-^|7y^)'E^T-lp 


/n    >^  0  rl-0^-^2    T.' 

\"^2 


11^02  [1-02_X2] 
'""  "(1-0^)2  (X^-X^) 

since   A     =   1-0^    .       Similarly, 


=  0  , 


n-pV  'TE-T  'p 


n2  0^02-X-|] 
(1-02)2 (A^-A^) 


n202 


D 


From  Corollary  1,  then,  we  write  the  exact  asymptotic  power  of  the  Box- 
Pierce  test  as: 


lim 


p(T('^^P>>c(f  ^10}  =  P(^0^  xJCO)  +  (l-02)x2(A)>cf^>)  ,     (3.3.15) 


where  A  -  1120?-/ (i-02)2  _  y\o\.}   the  probability  on  the  right-hand  side  of 
equat Lo:i  (3.3.15)  is  not  an  easy  one  to  compute,  since  the  constants 
inulitplying  the  single  degree  of  freedom  x   random  variables  are  unequal. 
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In  fact,  the  problem  of  obtaining  the  exact  probability  remains  unsolved. 
In  Section  3.3.3.2,  we  present  three  methods  of  approximating  the  right 
hand  side  of  (3.3.15). 

Corollary  2 :   Under  the  alternative  error  model  given  in  equation  (3.3.13), 
the  exact  asymptotic  power  of  the  max-x^  test,  T   =  max(nr2,  nr 2) ,  Is 
given  by: 


limP(T^™^cf^  =  1- 


/ 


cf^l-0') 
1l+0 


>-l 


^c^^-^0 


/l-0^ 


(3.3.16) 


-^c^>-  /^ 


/l-0^ 


where  $( 


-/: 


(2tt)   e  ^  dz 


Proof :   Let  C^  =  C  and  start  by  writing  the  power  of  the  max-X  test  as 
follows: 


P{T^"-^>C|0}  =  P{max(nr^,nr2)>C} 

=  1-P{max(nr^,  nr2)<C} 


From  the  asymptotic  distribution  given  in  (3.3.14),  we  have  that  for 
large  n,  *Tir.  and  "nr^  are  distributed  as  Independent  normal  random 
variatesj  hence. 


lira  P(T*-'^^>C|0}  =  l-P{nr2<C]-P{nr^<C} 


1-P{  -v'^<  /nr-|^<  /C}  •?{  -/C<  ^^\T^<  »^} 
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-/C 


=  1-P 


(1+0)^ 


<  Z  < 


/c 


(1+0)' 


1-5 


i-/c-/^0        /c-'^0 
/l^  /l-0'^ 


1- 


1- 


'/C(l-0^) 

11+0 


/C(l-0-^) 
2-^'S      1+0 


-/c(l-0^) 


^  1    1+0 


|/c-/n0 


-1 


/C-/n0 


-/C-/n0 


-/c-/n0 


/1-0' 


D 


of  course,  tables  are  available  for  computing  tail  areas  of  the  standard 
normal  distribution.   Thus,  for  the  special  case  (J=2,  K=2) ,  the  exact 
asymptotic  power  can  be  calculated  for  the  max-x   test.   Hox-zever ,  the 
notion  of  exact  asymptotic  power  is  the  exception  rather  than  the  rule. 
The  researcher  who  attempts  to  calculate  powers  utilizing  an  analytic 
approach  similar  to  the  w^ork  above,  will  more  often  than  not  be  forced 
into  approximating  the  true  asymptotic  power,  as  with  the  Box-Pierce 
statistic.   This  point  is  further  illustrated  in  the  following  section. 

3.3.3.2  Model  2:   The  Case  J=2 ,  K=4 

Again,  let  us  consider  model  (3.3.13)  as  an  appropriate  representa- 
tion of  the  residuals  when  serial  correlation  is  present.   Now  we  base 
the  test  on  the  first  four  sample  autocorrelations  i^i,    t^t  <  ^o^  ^4^' 
Call  this  the  case  (J=2 ,  K^4) .   From  equation  (3.3.5),  we  observe  that 
p,=0,  P2=05  Po=0   and  p  =0^ .   Applying  (3.3.9)  gives 

„   -  (1+0)^ 


11     1-0?- 
=  1-02 


'22 


'33 


1+02^+403-20'' 
1-02 
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^44  = 

1+02- 
1- 

-50'^+30^ 
4' 

=  1+202 

-30'* 

■ 

The 

covariances 

,  obtained  from  (3.3. 

10), 

are 

computed 

as 

follows: 

^12  = 

0   , 

^13  = 

0^(3- 
1- 

-02)+20 

4' 

20+302 
1-02 

-t 

^14  = 

0, 

-23  =  °' 


24 


20-03(4-202)  _  20(1-202+0-^)  _ 


Then,  as  n  tends  to  infinity,  the  vector  /n(r-p)  is  distributed 
asymptotically  normal,  with  mean  vector  0,  and  dispersion  matrix  V, 
where 


(1+0)2     „     20+302-0'* 
1-02       ^  ~T^ 


0 


a 


0 


0 


20(1-02) 


20+302-0'*      l+02+403_205 

1-02     "  ~   \^^ " 

0     20(1-02)     0      1+202-30'* 


(3.3.17) 


The  m.ethod  of  obtaining  exact  asymptotic  powers  in  the  case  (J=2 ,  K=2) 
depended  heavily  on  the  independence  of  the  first  two  sample  autocorrela- 
tions.  The  addition  of  the  third  and  fourth  order  sair^ple  autocorrelations 
into  the  testing  procedure  contribute  nonzero  off-diagonal  elements  to 
the  covariance  structure,  V.   These  covariances  make  the  distributional 
problem  so  complex,  that  the  researcher  is  forced  to  abandon  the  search 
for  exact  as>TPptotic  powers  and  seek,  instead,  approximate  asymptotic 
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powers.  In  the  subsections  that  follow,  we  examine  several  approximate 
procedures  for  the  Box-Pierce  test,  and  one  approximation  for  the  max-x 
test. 

3.3.3.2.1  Approximate  asymptotic  power  of  the  Box-Pierce  test 

Three  approximate  methods  for  computing  the  asymptotic  power  of  the 
Box-Pierce  test  are  given  in  theorem  form,  and  are  labeled  as  follows: 
(i)   Imhoff  numerical  integration 
(ii)   Extension  to  Pearson's  three-moment  approximation 

(iii)   Rao  asymptotic  normality. 

Lemma  6  (Imhoff) :   Let  x  have  an  n-variate  normal  distribution  with 
mean  \i   and  covariance  V,  where  V  is  an  nxn  symmetric  positive  definite 
matrix.   Consider  the  quadratic  form, 

Q  =  x'Ax=  J^A.x^  (6|), 

1 

V7here{A.},  {m  },  and  {6?}  are  defined  in  Lemma  2.   Then 


P{Q>C}  .  l  +  lP  ^i"  Q("Idu 


where 


and 


0(u)  =-  .E  Jm.  tan  '  (A  .  •u)+6?A  .uCl+X^  a2)  M--|cu  , 
2  1=1   1        1     11     1         2 


p(u)  =   n  (l+xV-)^i-exp{i  .Z  (5.A.u)2/(1+a2u2)}  . 
i=l    1  2  j==l  2    3  1 

Proof :   Imhoff 's  result  is  obtained  by  inversion  of  the  cliaracteristic 
function  of  the  variable  Q.   For  details,  see  Imhoff  [23],  pp.421.    Q 

Theorem  7  (Imhoff  numerical  integration) :  Under  the  alternative 
model  given  by  (3.3.13),  the  asymptotic  power  of  the  Box-Pierce  test, 
based  on  K=4  sample  autocorrelations,  is  given  by 
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11m  P[  T^^'^Kc^^^h   =  i  +  ^  r  ^^^^4^  du  ,  (3.3.18) 

a       2   TT  /     up  (u) 
n-x»  ^  o 

where 

G(u)  =^  .^[m.  tan'l(A.u)  +62a  .u(1+a2u2)'1]-  ^  C^^^^u  , 
'    2  1=1   1      ^i'    11     i'-'2a 

p(u)  =  ^n^(l+A?u2)^™iexp[|  .E^(6.A.u)2/(1+a2u2)  , 

and  V7here  {.A.}  are  the  eigenvalues  of  the  matrix  V  given  in  (3.3.17), 

with  respective  multiplicities  {m.},  and  {  6?}  are  obtained  from  (iv) 

11 

of  Theorem  2. 

Proof:   The  result  follows  directly  from  Theorem  2  and  Lemma  6.    D 

The  power  expression  in  (3.3.18)  results  from  Imhoff's  ability  to 
find  the  distribution  function  of  a  linear  combination  of  non-central  x 
random  variables  explicitly.   However,  the  integral  in  (3.3.18)  cannot 
be  computed  analytically.   Imhoff  outlines  a  procedure  in  which  the  re- 
searcher can  approximate  the  power  by  a  numerical  integration  method. 
In  Chapter  4,  approximate  asymptotic  powers  of  the  Box-Pierce  test  for 
this  case  (J=2,  K=4)  and  others  are  calculated  by  means  of  Imhoff's 
procedure  using  numerical  integration. 

Lemiaa  7  (Pearson):   Given  the  conditions  of  Lemma  3,  tail  areas  of 
the  distribution  of  the  quadratic  form  Q  may  be  approximated  as  follows: 


P[Q>C}^r{  x^(0)>CA}, 


3 


whe] 


2     n-;,     -     fr-.,     \.   fu  I -^     A  2  .  u    ^  ^  ^  >  J 


re  h  -  ''Z/a^  ,  C'V  =  (C-a^)  •  (h/a^) '+h,  a  .  =  ^^^aJ  (ra^+j6|)  (j=l,2,3) 

andY2(0)  a  central  x^  random  variable  with  h  degrees  of  freedom. 
'  h 

Proof:   The  result  is  derived  by  extending  Pearson's  [25]  "three-moment 
central  x^  approximation  to  the  distribution  of  a  non-central  x   to 
the  general  case  of  a  quadratic  form  in  normal  random  variables.   Details 
are  given  in  Imhoff  [23],  pp.  425.        D 
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Theorem  7  (Imhoff's  extension  to  Pearson  3-moment  approximation): 
An  approximation  to  the  asymptotic  power  of  the  Box-Pierce  test  is  given 
by: 

lim  P[T^^^^>C^^^h^P[xJ(0)>C*},  (3.3.19) 

n-x=° 

where  h=^2/a2   c*=(C^^^^-a  J  •  (h/a„)  ^^"  +  h,  a  .  =  .  L  A^  (m.+j6?)  ,  (j=l,2,3), 
J       a     1      2         J  1=1  1  1  -^  X    -^ 

{  A  .  >,{  m.},and  {  5?}  defined  as  in  (iv)  of  Theorem  2,  and  where  ":>;" 
111  '  ^ 

represents  Pearson's  3-moment  central  x^  approximation  to  the  distribution 
of  a  non-central  x^- 

Proof:   The  results  of  Theorem  2  enable  us  to  write  T     as  a  quadratic 
form,  Q.   Apply  Imhoff's  extension  to  Pearson's  3-moraent  approximation 
(LeiTOTia  7)  and  the  result  follows.     Q 

Since  h  in  Theorem  7  need  not  necessarily  be  an  integer,  the  user  of 
this  ejLtended  three-moment  approximate  method  must  have  access  to  a 
computer  routine  v^7hich  computes  tail  areas  of  central  X   random  variables 
with  non-integer  degrees  of  freedom.   For  a  numerical  application  of  this 
result,  see  Section  (4.1). 

Lemma  8  (Rao):   Let  /n(x-y)  — ^>  NJ0,Z}  and  let  g:  R^ >  r 

be  a  continuous  function.   Then,  under  certain  regularity  conditions, 

*^{g(x)-g(y)}  -^  N[0,C'2O, 


where 


8g(t) 


Uj'   ^"^2 


3g(t) 

'2'  •  •  •'   ^^K 


Proof:      See   C.R.    Rao    [27],    pp.  387.  D 

Theorem  8:       (Rao's   as>TnpLOtic   normal    tranf ormation) :      An  alternate 
form  for    the  asjinptotic   pov/er   of    the   Box-Pierce   test    is   given  by: 
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ti.,  P,T<-)>C<f>,  =  l-.r°  7'"',  «  -^°  ,-^'"'7  .  (3.3.20) 

(p'p)  '(p'Vp)M      (p'p)  '(p'Vp)^ 


where 


/   (2TT)  ^ 


$(x)  =  /  ilT^ye^^^^^dz    , 


where  p  and  V  are  the  asymptotic  mean  vector  and  asymptotic  dispersion 
matrix,  respectively,  of  the  vector  of  sample  autocorrelations,  r. 

Proof:   From  Lemma  1,  we  have  ^"(r-p) >  N  {0,V}  ;  hence,  we  may 

apply  the  result  of  Lemma  8.   Consider  the  function 


;(t)  =  (t't)'  =/t^  +  t^  +  .  .  .  +  til 


Then, 


38(t) 


=  i(t2  +   tl  +    .    .    .    +   tl)    ^(2t.) 


at.    2'  1   2        K' 

1 

=  t,(t't)~^   ,   (i  =  1,  2,  .  .  .,  K), 


and 


8g(t) 


8t, 


=  p.(e'p)  '  ,      (i  =  1,  2,  .  .  .,  K), 


imply  that  t,   =    (p'p)  ^P  •   Thus,  from  Lemma  8: 

/iTlCr'r)"^  -  (p'p)*}— ^— >  N{0,  (p'p)"^p'Vp} 

j_ 

For  large  n,  v^e  see  that  /n(r'r)^  has  an  approximate  normal  distribution 

V7ith  mean  /n(p'p)^  and  variance  (p'p)   p'Vp.   We  compute  the  asymptotic 
power  by  writing: 

p{,j,(BP)^^j  =  P{nr'r>C}  =  l-P{nr'r<C} 

± 

=  l-P{-/c</n(r'r)''</c}  . 

Taking  limit?  on  both  sides,  we  have 
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,(BP). 


-/c-/n(P'P)^         /C-/^(P'P)' 


lira  P{t'   '>C}  =  1-P  )  (g'e)-i(g'Ve)i   Z   (p'p)~i(p'Vp)2 
)(p'p)-5(p'Vp)i  "^  ^  )(p'p)-i(p'Vp)i 


D 


We  apply  this  result  (Theorem  8)  to  the  case  (J=2,  K=4). 
Corollary  3:   For  the  case  (J=2,  K=4) ,  the  asymptotic  power  of  the  Box- 
Pierce  test  is  given  by  the  expression: 


lim  P{T^^^)>c(^^h=  1-^ 


•I+4FE20^zM^ 


i    i+F 


(3.3.21) 


Proof;   Recall  that,  for  (J=2,  K=4),  p  =  (0,  0,  0,  0^)',  and  the  matrix  V 
is  given  by  (3.3.17).   Then  p'q    =  f-   +  <t)^    =   02(1+02)  and 

p'Vp  =  [0,  0(l-02)+02  [20(1-02)],  0,  0[20(l-02)}f02(l-202-30't)] 

=  02  (l-02)+20'*  (l-02)+20^  (l-02)+0^  (1+202-30^*) 
=  02+404_206_308 

=  02(l+402-20'+-305)  . 
Thus, 


(p'p)  '(p'Vp)f^=  [0v^+0^]  ^-  0  •  /l+40^-20'^-30° 


l+402-20'*-305 


1+0 

Now  utilize  equation  (3.3.20)  in  Theorem  8  to  obtain  the  approximate 
asymptotic  power  expression: 

'^^^  -  0./:7(i^Fy|   1  -"^  -  0>/^^cn:F-)] 


1- 


fl+40  2--20't-306 
1+0  2 


+  ^1>' 


/l+40  2-20''-30' 


D 


1+0  - 


60 


A  comparison  of  the  three  approximations  for  computing  the  power  of 
the  Box-Pierce  statistic  is  found  in  Chapter  4. 

3.3.3.2.2  Approximate  asymptotic  power  of  the  max-x    test. 

We  now  restrict  our  attention  to  the  max-x^  test.   For  the  case  (J=2, 
K=4),  the  asjrmptotic  power  of  T    may  be  written: 

P{T^"^'^>C}  =P{n  max  r.2>C} 


=  l-P{nr^<C,  nr2<C,  nr2<C,  nr|<C} 

=  l-P{->^</nr  </g",  .  .  .,  -/c</nr,</c} 
1  4 


Let  X  =v'm: .  and  y  .=  no.,  l-i-4.   Then  the  problem  is  to  evaluate 
i    1      11 


f(x:  y,  V)  dx^dx^dx^dx^,   (3.3.22) 


where  f(x:  y,V)  is  the  joint  density  function  of  the  first  four  sample 
autocorrelations.   For  large  n,  /nr  is  multivariate  normal;  thus 

f(x:  y,V)  =  -^^7^2exp{-  |(?-y)'v"l(x-y)}  . 

Due  to  the  presence  of  offdiagonal  elements  in  the  matrix  V,  the  exact 
computation  of  the  multiple  integral  in  (3.3.22)  becomes  extremely  cumber- 
some.  The  researcher  must  again  resort  to  approximate  methods.   We  propose 
a  Taylor-series  expansion  method  of  approximating  (3.3.22). 

Definition  1:   Let  y  =  (y-i  ,  yo,  .  .  .,  y^^)  '  he  distributed  as 
multivariate  normal,  with  E(y  )  =  0,  E(y  2)  =  i   iIiIr,  and  E(v.y.)=C.., 

1-i-K,  1-j-K,  irj  (i.e.,  y  -  N  {0,  R} ,  where  R=(C. .)  is  a  correlation 

-    K  ~  ij 

marrix) .   A  Taylor-series  expansion  of  the  density  of  v,  f(y:  0,R),  about 
the  elements  C--  in  R  is  defined  as  follows: 


f(y:  0,R)  =  ^^^ 
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K   K   (C..)'^       t 
.^  .^  -^—.J—-^   f(v:  0,R) 


L    i<j 


ij 


{c..}=o 
IJ 


where  {C..}=0  implies  C..=0  ¥i,j  (ij^j).    Q 
For  notational  purposes,  let 


(3.3.23) 


9      Yf(y:    0,R) 


ij 


=    (-3— )''fo■ 
{C..}=0       'sc./ 
ij  iJ 


Expanding    (3.3.23)   V7e  obtain: 


^f 


f(y:    0,R)    =   {f(Y:    0,1)1   +     C        3C-^2   °  +  ^13  ^"^13  °  "*" 


+  C 


12        12   "        "13 

— ^— f 


2     12  ^-12        o 


+  C 


K-1,K^3C 


)  f^  +  ^12*^13^  cTj: 


(3.3.24) 


-)f 


K-1,K 


12   13 


.    C  C  (-. ^p )f   > 

K-2,K  K-1,K  8Cj,_2^^  Vl,K     ° 


^VM2^^'\^ 


-  4-l,K<3.^)^^o  -   ^L^13^3cL-,3)^o 


■)f    } 


^K-2,K  K_1,K  8C^_2^j,   C^_^^^     o 


a: 

We  will  attempt  to  simplify  equation  (3.3.24)  in  order  to  make  it 
more  workable  for  the  practical  researcher.   To  do  this,  we  introduce  the 
concept  of  Hermite  polynomials. 


Definition  2:    Let  (J)  (x)  represent  the  density  function  of  a 

univariate  N(0,1)  random  variable  (i.e.,  <i>   (x)  =  ^j=^—'  e    ^^   )  .      T\\e   n'- 

y'2'n 


th 
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Herraite  polynomial,  H  (x)  ,  is  defined  from  the  following  identity: 


(-l)'^H  (x)  9  (x)  =  (A-)"<f,(x).  Q  (3.3.25) 

n  dx 

The  properties  of  Hermite  polynomials  are  given  in  the  following  lemma. 
Lemma   9 :   Let  H  (x)  be  the  n   Hermite  polynomial.   Then  H  (x)=l, 


Ht(x)=x,  H  (x)  =  (x'^-1),  H  (x)=(x3-3x)  and, in  general, 


H^^j_(x)  =  xH^(x)   —   (fx)«n(^)   •  (3.3.26) 


Proof :   By  convention,  take  H  (x)=l.   Now, 


%)<?(x)  =  -x(l,(x), 


(^)  ^(x)  =  -(!,(x)  +  x2  4,(x)  =  (x2-l)<^(x)  , 
(|-^)%(x)  =  (2x)({)(x)-x(x^-l)^(x)  =  -(x^-3x)<^(x). 

c'x 


and 


By  equation  3.3.25,  then,  H^(x)=x,  H2(x)  =  (5^-1)  and  H^(x)  =  (x^-3x) 
In  general,  the  (n+1)^^  Hermite  polynomial  is  found  as  follows: 


(-i)"+\^-^(x)c:.(x)  -  (^)^+i<^(x) 


=  r3  ^{  (-^^"ac^-^J 


=  (-1)"{[(3  )!'  (x)].(J)(x)  -  xH  (x)(f.(x)}  . 
dx  n   J  n 

Thus,  v;e  obtain  the  (n+1)^'"  Hermite  polynomial  from  the  recursive  relation; 
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In  the  lemmas  that  follow,  the  application  of  Hermite  polynomials  in  the 
problem  at  hand  becomes  evident. 

Lemma  10:   Given  the  conditions  of  Definition  1,  we  have: 


(i)  (■^)^f(y:  o.R)  =  ^-^^h—^^^^V  9'^)'    1-i-^'  1-J-^'  ^^i 


(ii)  (.  m,  n)-(y=  0,R) 


{C,.}=0 


=  Hm(yi)^'n(yj)f(x:  Q.D 


Proof:  The  proof  of  (i)  is  straightforward.  Perform  the  required  partial 
differentiation  of  the  density  f(y:  0,R)  on  each  side  of  the  equation,  and 
the  result  follows  (this  requires  many  tedious  computations). 

We  derive  the  identity  in  (ii)  for  the  case  K=2.   For  the  case  K=2, 
we  have 


R 


'12 


C,2   1 


R-^=(-^,-) 
1-C12 


-C 


12 


-C,2   1 


and 

1  -J- 
72^ 
Applying  (i)  and  taking  the  partial  derivatives,  we  obtain 


f(y:  0,R)  =  J^U exp{  -  \iyl-'2-C-^2^ -^^ 2^^1^  '   ITc^^ 

(2tt)  12 


^^^'^r-  °.«  =  <iy^>f<y^  ?•« 


a2 


(-^){f(y:  0,R)-(-^^M2-^-)) 


''l2^2_2l. 
^12 


Cio  C3  2y2-yi   ^iiy^-yi 

=  f(y:  0,R)  (-^^)  +  f(y:  0,R)  (-y-,;7-)(  ^._^2      ) 
1  u^2  -^"^12        12 


Taking  C-io"^  i'^  '^'^^  above  equation  gives: 


(— 2-)f(y:  0,R) 
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=  yiy2f(y--  0,I)=H^(y-L)H-,^(y2)f(y:  0,1) 
{C..}=0 


The  proof  of  the  more  general  result  (ii)  follows  a  similar  argument.   Q 

Lemma  11:   Given  the  conditions  of  Definition  1,  the  Taylor-series 
expansion  of  f(y:  0,R)  can  be  expressed  as  follows: 

f(y:  0,R)  ={[1]  +  [C^2"^(y^)H^(y2)  +  C^3H^(y3^)H^(y3)  +  .  .  .  + 

CK-i,K«i(yK-i)»i^yK)^ 

+  i  t^L  ^z^yi^h^yi^"----   +  c|_i^K"2^yK-l>^^2V  +  C,2Ci3H2(yi)Hi(y3)ii^(y2) 

+  •  •  •  +  V2,KVl,K«l(yK-2^"l^>'K-l>"2(V] 

+  3  [Cl2"3^yi^"3^y2)  +  •  .  •  +  c3_^,A^yK-l)«3(V 

+  c22C^3H3(y^)H2(y2)H,(y3)H-  .  .  .  +  C^_2,K<_iHi(yK-2)»2^>^K-l>«3  V  ^-  '  ' 

+  S2^l3^14"3^yi^\^^2^"l^y3^"l^y4^  ■"  '  '  ' 

+  V3,K^K-2,KVl,K^^l(yK-2>"l(yK-l^"3(yK)Hi(yK_3)] 

+i   [...]+...}  f, 

v.'here  f^  =  f(y:  0,1)  =  (j)  (y^)<{)  (y^)  .  .  .  <{>  (yj,)  . 

Proof:   Apply  the  results  of  Lemma  10  directly  to  equation  (3.3.24).  [] 
Lemma  12: 


/ 


b  f$(b)-0(a)     .  .  .n=0 

H„(x)(t'(x)d^. 

Hj^_l(a)(Ka)-H^-l(b)c:,(b)  .  .  .  n  -  1 


1     J-  2 
/2tt 


and 
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(x)  =    (f)(z)dz 


Proof:   For  n=0, 


I  II^(x)^(x)dx  =  I    <|)(x)dx  =  /  <;,(x)dx  -  /  <f>(x)dx  =  ^(b)  -  $(a) 


I'or  n  -  1, 


y^H^(x)Kx)d^=J^d[-H^_^ 


(x)(t)(x)]  =  -n^_^(x)^ix) 


=  H  Aa)'^(a)    -   H   ^(b)*^) 
n-±  n— 1 


D 


Lemma  13: 


'1  ni 


n^  1  n^  2         n^  K    1    ^ 


4'(yx,)d  d 


1  '2 


y-^ 


i=l   i  1  • 


n.  -  1  V. 


.n^[$(b.)-$(a.)] 


n.  =  0  ¥. 


i,0(.)-.(a,„  J^,t"„..<^'*<^'-*'„.l<^i>^<^>^  • 


where  n  ,  n  ,  . 

are  reordered  so  that 

<  .< 
n.=0,  1-i-m 

n.-l,  itt4-l-i-K  . 


'.  K 


Proof:   Break  up  the  integration  as  follows; 


1     X 


a/n2^>'2)^(y2) 


,  H  (y  )<^,(y  )d 
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The  result  now  follows  directly  from  Lemma  12.     P 

We  now  return  to  the  problem  of  evaluating  the  multiple  integral  in 
(3.3.22).   Let 


where  V=(v..),  l-i-4,  l-j-4.   Then  y  -  (Yt  ^y^^y^.Y/,) '  is  multivariate 


'l'^2'^3'-'4' 


nonrial  with  mean   0  and   dispersion  matrix  R=(C..),    where   C..=l   and 


JJ_ 


11   JJ 

The  asymptotic  pov/er  of  the  max-x^  test  for  the  case  (J=2,  K=4)  may 
now  be  written: 


p{^(m)^^(m)j    =   1 


'i  r^2  rh  ^^ 


f(y:    0,R)dy.^dy2dy^dy^,    (3.3.28) 


where 


-   C  -   /np  . 


and 


C  -   vnp, 


b.   - 


l'-±U. 


The  Taylor-series  expansion  of  f(y:  0,R)  is  used   to  obtain  an  approximation 
of  (3.3.28). 

Theorem  9  (Taylor-series  approximation):   A  Taylor-series  approxima- 
tion to  the  asymptotic  power  of  the  max-);^  test  for  the  case  (J^2,K=4) 
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is  obtained  by  computing 

l-J[2^(b^)-l]-[^(b2)-$(a2)][24>(b^)-l][^(b^)-$(a^)]  (3.3.29) 

+{C2^[2<J)(b^)-l]  [2*(b3)-l]  •  [cf,  (a^)-*  (b2]  [<^  (a^)-<{)  (b^D 

+  ^  [^ih^)-^(a^)  ]  [$(b^)-<D(a^)  ]  [C2^]  [4b^(}.  (b^)b3<?  (b^)  ] 

+  [2<i)(b^)-l]  [2^(b3)-l]  [C2^]  [a^cf  (a2)-b2<{>  (^2)  1  [  V  ^^^~V  ^^4^  ^  ^ 

+  I;  UC|^]  [2^(b^)-l]  [2<l>(b3)-l]  [  (a|-l)<))  (a2)-(b|-l)<^  ^2)  ] 

[(a2-l)(l,(a^)-(b2-l)Hb^)] 
+  [CJ3C24]  [4b^*  (b^)b3c}.  (bg)  ]  [(|.  (a2)-(f>  (b2)  ]  [=!)  (a^)-*  (b^)  ]  ) 
+  |,{[$(b2)-4>(a2)][$(b^)-$(a^)][q3][4(bj-3b^)<|>(b^)(b3-3b3)<^(b3)] 

+  [C^^]  [2$(b^)  -1]  [2<l'(b3)  -]  ]  [  (a^-3a2)<}'  (32)  -(b^-3b2)Mb2)  ]  *  [  (a^-3a^)4>  (a^) 

-(b3-3b^)<j(b^)] 

+  [c23C'^^][4b-^<^(b^)b3(l)(b3)][a2Ma2)-b24'(b2)][a^Ma^)-b^Kb^)]} 

+  -  {[c5^][2<l'(b-^)-l][20(b3)-l][(a5-6a2+3)<^(a2)-(b^-6b^+3)Kb2)] 

[  (aJ-6a2+3)  (^  (a^)  - (bJ-6b2+3)  <))  (b^)  ] 

+  [cJ3C24][4(b3-3b-^)Kb^)(b3-3b3)4'(b3)][<}.(a2)-<}'(b2)][Ka^)-'^(b^)] 

+  [C^3C^^][4b^<}>(b^)b3<i'(b3)][(a2-l)na2)-(b^-l)Hb2)][(a2-l)na^) 

-(b^-Dt^Cb^)]} 

+  i  {  [ Cf  3]  [  $(b2) -5>(a2)  ]  [  OCb^) -^'(a^)  ]  [ 4  (bj-10b3+15b^)  4- (b-^)  (b5-10b3+15b3) 

<i'(b3)] 

+  [Cj3c|4][4(b3-3b^)4'(b-^)(b^-3b3)<j'(b3)][a2*(a2)-b2'>(b2)][a4<>(a^)-b4<^(b4)] 

+  [c23C^^][4b^'l(b^)b3'^(b3)][(a^-3a2)*(a2)-(b|-3b2)^(b2)] 
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+  [C^^][20(a^-l)-l][2'l'(a3)-l][(a|-10a3+15a2)({)(a2)-(b^-10b3+15b2)<t>(b2)]' 
[(a,^-10a3+15a4)Ma^)-(b5-10b3+15b^)<i,(b4)], 


where 


^(x)  =  -7=ze-^^,     $(x)  =   <^(z)dz. 


20+302-0^ 

20/i-0^                           '^d™>  (1-0^ 

*"13   "    (l+0)/l+0^+403-20^ 
'^C^^-v^0 

'   ^24  ~   /l+20^-30'*    '   ^1  -          1+0 

-^c('")-/n0            ^       v/c(-)(l-0^) 

'"2          /1-02                  '      -^2 

/7— zn-                    ,        b-3    , 

v'x-0^                       -"   /l+0^+403-20^ 

^C^")-v^0 
1                <^                                  -,^^ 

a 

b,    -                                     ,      and 

"^j 

'^        /l+20^-30'+ 

""        /l+20'^-30^ 

Proof:   From  earlier  results  (3.3.17), 

(1+0)2       _  2^30?-0^ 
""11  ^  ~1^   '   13  "   1-02 


V22  =  1-0^   ,   V2^  =  20(1-02)   , 

1+02+403  ^M^  1^9M^  .014 

V33  =    i_02     ,  v^^  =  1+20-30^  , 


^12  =  ^14  =  ^23  =  ^34  =  °  ' 


hence,  the  elements  of  R  are  written. 


^11  -  *^22  -  ^33  ~  ^44    ^' 


^12  =  ^4  =  "^23  =  C34  =  0  , 


^13  ~  (l+0)/l+02+403-20=    ,  C^^^   =  /j4.-2-0^l3| 
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Now  p=p   =0,  p   =0,  p=0^  implies  that 


-V"')(l-0  )  /  (m) 


1       1+0 


b  =  cr^(-i-0^) 


1+0 


-'^-/n0         ,  =  V™>-/n0 


^2 


/i^  /i-0^ 


>\i-0^)         ^c(™)(i-02) 

lo  = >     bo — 

^        /l+0^+40^-20^  /l+0^+40^-205 


-^C("^)-V'^02  *'c('")-v^02 

^    /i+20^-30'*  '     ^    /l+20''^-30'^ 

in  the  power  expression  3.3.28).   Put  0^2  =  ^24  =  C23  =  C^^  =  0  in  equation 

(3.3.27),  to  obtain  the  Taylor  series-expansion: 

f(y:  0,R)  =  {[l]+[Ci3H-^(y^)Hj^(y3)+C24H^(y2)H^(y^)l+|[43H2(yi)H2(y3) 

(3.3.30) 
+  c|4H2(y2)H2(y4)+43C24H^(y^)H^(y2)%(y3)H^(y4)] 

+  ^,jA3^-3^^1^S^^3>^   C^^«3(y2>"3(^^  "-   c'i3C24H2(yi)H^(y2)H2(y3)H^(y^) 
+  Cl34«l^V"2^y2>«l^V"2V^ 

+  tl  ^43"4(>'l)«4(y3)+SA(y2)\(V+4S4"3^V"l^^2)^S^V^^y4^ 
+  44H2(y^)H2(y2)H2(y3)H2(y4)  +  43C24H^(y^)H3(y2)H^(y3)ll3(y^)] 

+  |,[c|3H5(y^)H3(y3)  +  cl^S(Y2^n^(y  ^-^   +  4344"4(yi>%(y2^"4^y3^"l^  V 
■^  ^l3^'24%^^'l^»2(>'2)»3(y3)"2^^4)  "^  ^13'24"2^>^1^"3(>^2^"2^^3^^^^^ 
+  C,344"l(^l)^^y2>^(>'3^^^^^  ■'i!f'l3»6(yi)"6(y3^  +  '^uV^'2^\^\'^ 
+  43C24"5(>'i)^(y2^"5(y3>\(y4)  +  4344"4(yi)^(y2^^^y3^"2^y4^ 
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,3  ^3  „  ,.    v„  ,  .  ^„  r.r    N„  f..    ^     ^    n"^     n"* 


+  C^3C^^H3(y^)H3(y2)H3(Y3)H3(y^)  +  C^3C2^H2(y^)H^(y2)H2(y3)H^(y^) 
+  C^3C2^H^(y3^)H3(y2)H^(y3)H^(y^)]  +  .  .  .}  f(y:  O.I)  . 

Before  integrating  (3.3.30),  notice  that  (J)(x)  is  an  even  function,  i.e., 
(j)(x)  =  (})(-x).  Also,  Hj^(x)  is  an  even  function  when  n  is  even,  and  is  an 
odd  function  when  n  is  odd,  i.e.. 


H„(x) 
H„(-x)  = 

-Hj^(x)       ,  n  odd 

Since  a-j^=-bi  and  a3=-b3,  we  have  from  Lemma  9, 


'H^(x)Mx)dx  =  H^_^(a.)Ka.)-H^_i(b.)(^(bi) 


(3.3.31) 


=  H^_^(^b.)K-b.)-H^_^(b.)*(b.) 

i-2H  _,  (b.)(f)(b-)   if  n  is  even  (n-1  odd) 
0  if  n  is  odd  (n-1  even)  . 

Now  integrate  (3.3.30)  using  (3.3.31),  Lemma  9   and  Lemma  13  to 
obtain  the  desired  result.       □ 

In  Chapter  4,  each  of  the  approximate  methods  outlined  in  this  section 
will  be  applied  to  models  similar  to  (3.3.4),  and  numerical  powers  of  the 
two  tests  compared.   Also,  a  study  designed  in  part  to  determtine  the 
accuracy  of  these  approximations  is  conducted.   This  is  accomplished  by 
comparing  the  approximate  power  of  the  test  to  the  power  generated  from  a 
Monte-Carlo  simulation. 


CHAPTER  IV 

A  POWER  COMPARISON  OF  THE  BOX-PIERCE  "PORTMANTEAU", 
MAX-x^,  AND  d  TESTS 

In  Sections  3.1  and  3.2  we  presented  two  testing  procedures,  the 
Box-Pierce  "portmanteau"  and  max-X   tests,  designed  to  detect  serial 
correlation  of  the  errors  in  the  presence  of  a  general  alternative 
error  structure.   In  Chapter  4,  an  extensive  power  simulation  study 
is  undertaken.   Our  goal  is  three-fold.   First,  we  \<^ish  to  substantiate 
the  conjecture  that  the  Box-Pierce  and  max-x^  tests  attain  high  power 
in  the  general  case.   Secondly,  we  investigate  the  specific  types  of 
alternative  error  models  for  which  one  test  outperforms  the  other. 
FinalJy,  the  accuracy  of  the  asymptotic  power  approximations  (Section  3.3) 
is  determined  by  comparing  the  simulated  power  to  the  approximate  power. 
4.1  Monte  Carlo  Simulations 

Recall  the  stationary  AR  model  of  order  p  with  lag  coefficients 

(0  ,  0„,  .  .  .,  0  )  given  by  equation  (3.3.1).   In  order  to  obtain  the 

simulated  powers  of  the  tests  via  the  Monte  Carlo  method,  a  technique 

for  venerating  the  sequence  of  observations  Z^ ,  Z_,  .  .  .,  Z  needs  to 
'-        "       ^  1   2  n 

be  developed.   We  adopt  a  procedure  in  which  the  first  p-variates  Z  , 

Z„,  .  .  .,  Z   are  generated  so  that  they  possess  the  desired  covariance 
2  P 

structure  of  the  general  alternative  error  model  under  consideration. 

The  remaining  n-p  variates  Z  ,  _,  ,  Z  ,„,  .  .  .  Z   are  then  calculated 
°        '  P+1   r+2         n 

recursively  from  equation  (3.3.1).   However,  the  formation  of  the  co- 
variance  structure  first  entails  computing  the  vector  of  true  autocorrelations, 
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p.  Given  the  lag  coefficients  (0^,  0„,  .  .  . ,  0  )  of  the  model,  the 
vector  p  is  easily  obtained.  The  relationship  between  p  and  the  lag 
coefficients  is  given  in  the  following  lemma. 

Lemma  1.4:   Consider  the  stationary  p   order  AR  model 

where  (e  )  is  an  uncorrelated  series  with  mean  0  and  variance  a^,  and 
the  vector  of  lag  coefficients  0  =  (0..,  0„,  .  .  .,  0  )   is  knol^m.   Let 
Y  and  p  represent  the  vectors  of  true  autocovariances  and  true  auto- 
correlations, respectively,  where  y  =  E{Z  Z  ,  },  p  =y~'^Y  >  v=0,  1,  2,  . 

'  V  t    t+v  V      o      V 

Then  Ap=0,    where   the   elements   of    the  matrix  A  are   given  by: 

if   2i  -  p 
if   2i  >   p 


a .  . 


ij 


if   i+j    -  p,    i  <   j 
if   i+j>p,    i  <   j 


'^''i+j~^i-j  "-^   i+J-P.    i  >   3 


i-J 


if    i+j>p,    i  >   j 


Proof:      Multiply   Z      in  model    (4.1.1)    by   Z    ,     ,    v=   1,    2,    3,     .     .    .,    p,    and 
take   expectations    to   obtain  the    true   autocovariances: 


Yl  =  0iY„  +  <i2^i  +  03Y2  +  V3  +  ^5^4  +  •  •  •  +  Vp-1 
Y2  =  0iYi  +  02Y,  +  03Y,  +  0^Y2  +  05Y3  +  .  .  .  +  0pYp_2 
Y3  =   0iY2  +   02Yl  +   ^3^0  +   Vl  ^   ^5^2  +    ■    •    •    +   Vp-3 


Y      =    0iY      1    +   0oY      o  +   0oY      o    +   0/Y      /    +   0rY      .+...+    0  Y    . 
p  1   p-1  2'p-2  3  p-3  4   p-4  5   p-5  p'o 
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Now  utilize  p  -  y   "^T   to  obtain  expressions  for  the  true  autocorrelations; 


'l  =  ^  +  ^2^1  +  ^2  +  Vs  +  ^4  +  •  •  •  + 


P   P-1 


Pt  +  0,  +  0„Pt  +  0,0^  +  0,p^  +  .  . 


ri 


3^1   "^4^2   "^5^3 


+  0  P   o 
P  P-2 


Pp  =  Vp-1  +  ^2Pp-2  +  ^3Pp-3  +  Vp-4  +  Vp-5  +  • 


Solving  the  above  equations  for  the  lag  parameters 


\   =  (l-02)Pi  - 
5^  =  -(0i+03)Pi 


^2  -  V3  -  V4  - 
-  (1-0^)P2  -  ^3  -  • 


'V    ""2'  ^3' 

3  p  , 
P  P-1 


-  0  P   0 
P  P-2 


gives ; 


0        p-0   „p„-0   „p„ 
p-1  1    p-2'^2    p-3  3 


+  P, 


or  in  matrix  form: 


(1-02) 


-3      -4 
-(0^^+03)    (1-0^)   -0^ 


P-1 

5 
P 


P-1 


p-2      p-3 


To   see  this  more  clearly,  consider  the  case,  p=4.   Expressions  for  the 
first  four  true  autocorrelations  are  given  by: 
p^  =  0^  +  02P^  +  0^p^  +   0^p^ 

P2  -  0P-^   +  02  +  03P-L  +  04^2 
P3  =  0,P2  +  02Pi  +  03  +  Vl 

P4  =  V3  +  ^2^2  +  ^Pl  +  K 
Now  solve  each  of  the  above  equations,  respectively,  for  0.,  J  =  1,  2, 
3,  4  to  obtain: 
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'3  "  "^^2"^^4'*Pl  "  ^1^2  "^  P3 


In  matrix  form,  we  have: 


1-0, 

-03 

-K 

0 

-(0^+03) 

1-0, 

0 

0 

-(0/0,) 

-i^ 

1 

0 

_-03 

-h 

-K 

1 

which  agrees  with  the  lemma  result , 


D 


The  simulation  technique  used  to  generate  the  powers  of  the  tests 

in  Sections  4.1.1  and  4.1.2  is  outlined  in  Table  4.1. 

2 
In  Section  4.1.1  we  examine  the  powers  of  the  Box-Pierce  and  max- X 

tests  when  the  vector  of  sample  autocorrelations  r  is  kno\>m,  i.e.,  when 

the  random  errors  {Z  }  are  observable.   Of  course,  in  practice  the  (Z  } 

are  unobservable.   We  have  indicated  (Section  3.3.2)  that  the  researcher 

must  instead  calculate  the  vector  of  estimated  sample  autocorrelations,  r, 

using  the  residuals  {Z  }  computed  from  least  squares  regression.   Power 

comparisons  of  the  Box-Pierce  and  max-x^  test  in  this  more  practical  case 

are  discussed  in  Section  4.1.2.   These  power  comparisons  also  include  the 

Durbin-Katson  d  test,  which  was  designed  to  test  regression  residuals. 

4.1.1   Observable  Residuals:   No  Regression 

In  this  section  we  present  a  power  simulation  study  assuming  that 

the  residuals  {Z  }  from  model  (4.1.1)  are  observable.   The  objective  is 

to  detect  power  trends  which  may  extend  to  the  more  practical  Instance 

in  which  powers  are  calculated  using  the  residuals  {Z  }  computed  from 

least  squares  regression. 
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TABLE  4.1 


MONTE  CARLO  SIMULATION 


ERROR  MODEL:   Z  =  0-,^   ,  +  1i^   _+...+  0  Z    +  ^t' 
where  {e  }  is  White  Noise 


STEP  1:   Utilizing  Lemma  14,  compute  the  vector  of  true  autocorrelations 

~  =A-'0  , 
where  p=  (p^,  p^,  •  •  •>?)'.  0  =  '^^^^    ^2'  * 
of  A  are  given  by: 


,  0  )''  and  the  elements 
P 


1-02^     if  2i  -  p 
if  2i  >  p 


if  i  +  j  -  p,  i<j 
if  i  +  j  >  p,  i<j 

^i+j-^i-j  if  i  +  j  -  P.  i>J 
if  i  +  j  >p,  i>j 

STEP  2:   Generate  the  covariance  structure,  T,  of  the  first  p-variates 
(Z  ,  Z  ,  .  .  . ,  Z  )  as  follows: 

^p-1 
^-2 


"^^p-l  ^p-2  ^p-3'  •  ■ 


where  y   =E{Z  'Z    }=y"P   ,v=1,  2,  3,  ...,p  and 
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TABLE  4.1 — Continued 


l-(Vl  +  ^2^2  +  •  •  •  +  Vp^ 


Without  loss  of  generality,  take  E(e^)  =  a^=  1. 

STEP  3:   V/rite  r=  TT'  where  T  is  a  pxp  lower  triangular  matrix.   Solve 

for  the  elements  of  T  using  a  computer  routine. 

STEP  4:   Generate  the  first  p  random  variates  Z  ,  Z„,  .  .  . ,  Z   by 

computing  Z  =  T'e   ,  where  Z  =  (Z,  ,  Z^,  .  .  . ,  Z  )'  ,  and  where  e   = 
~p      p         ~p     i   2  P  ~P 

(e  ,e„,  .  .  .,  e  )'  is  a  vector  of  independent  normal  random  variables 

with  0  and  variance  1.   (Many  computer  packages  have  routines  which 

generate  N(0,1)  random  variates.)   Note  that  Cov{Z  }  =  E{ Z  Z  '}= 

TE{e  e  '}T'  =  TT'  =  V,    and  thus  the  first  p  random  variates  generated 
~P~P 

have  the  desired  covariance  structure. 

STEP  5:   Compute  the  remaining  n-p  variates,  Z    ,  Z   2>  •  •  •>  Z^>  f^^oni 

the  recursive  relations  given  by  model  (4.1.1),  i.e.. 


Z  ^T  =  0-,Z  +  0„Z   ^  +  .  .  .  +  0Z     +   E 
p+1    1  p    2  p-1  p  1    p+i 

p+2    1  p+1    2  p  p  /    p+^ 


Z  =  0,Z   ,  +  0^Z   ^  +  .  .  .  +  0  Z    +  e 
n     1  n-1     2  n-2  p  n-p     n 

where  e    ,  .  .  . ,  e   are  distributed  multi-variate  normal  with  mean  0  and 
p+1  n 

covariance  I. 

STEP  6:   Use  the  generated  random  errors  Z  ,  Z^,  •  •  .,  Z^^  to  calculate 

the  first  K  sample  autocorrelations 


77 


TABLE  4.1— Continued 


^1'  ^2' 


,  r^,  whei 


2    -   K. 


y  Z  Z   . 

^     t  t-1 

u-e  r.  =  t=i+l     -^       ,  < 

'    ~^z '     '' 

STEP  7:    Compute  the  test  statistics,  t^^^^  =  n.E.'^i  ,  and  t''"*''  =  n  max 

1-3- 
Determine  whether  the  calculated  values  of  the  test  statistics  fall  in  their 

respective  rejection  regions: 


,(in) 


T(BP)  >  Y^ 


,(m) 


12     2 


1/K 


STEP  8:   Repeat  steps  1  -  7  N  times  where  we  selected  N  =  1000. 
STEP  9 :   Compute  the  simulated  power  for  each  test  as  follows: 


„       number  of  reiections 

Power  = 

1000 
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A  list  of  the  controllable  parameters  In  the  study  is  given  below: 

n  =  number  of  residuals  generated 

a  =  probabilility  of  a  Type  I  error 

K  =  number  of  sample  autocorrelations  included  in  the  Box-Pierce 
and  max-  x^test  statistics 

p  =  order  of  the  autoregressive  model 

(0  ,  0  ,  .  .  .,  0  )  =  values  of  the  lag  coefficients  in  model  (4.1.1) 

m   =  number  of  nonzero  lag  coefficients  in  model  (4.1.1) 

(JijJoj  •  •  •>    3    )    -   lags  associated  with  nonzero  lag  coefficients. 
Of  course,  there  exists  an  infinite  number  of  parameter  combinations.   For 
our  study,  we  have  attempted  to  select  those  model  parameters  which  are 
intuitively  appealing  to  the  time-series  analyst  and/or  econometrician, 
i.e.,  those  which  also  have  practical  applications.    Our  basic  error  model 
takes  the  form  of  equation  (3.3.4).   The  two  versions  of  this  model  used 
in  the  study  are:  (1)  the  first  order  AR  process  with  lag  J 

Z^  =  0Z^_j  +  .^  ,  (4.1.2) 

and  (2)  the  second  order  AR  process  with  lags,  J   and  J 

h  =   ^j/'t-J^  "■   ^/t-J2  ^  't   • 
The  parameter  values  of  each  model  are  given  in  Table   4.2  and  Table  4.3, 
respectively.   In  order  to  present  the  results  of  the  study  in  a  clear 
fashion,  we  do  not  give  tables  of  the  numerical  power  simulations  in  this 
section.   Instead,  we  sketch  power  curves  for  various  cases  which  are 
typical  of  those  considered  and  which  also  best  emphasize  the  main  results. 
Tables  of  all  numerical  results  obtained  in  the  study  are  included  in  the 
Appendix  which  follows  the  final  chapter.   However,  when  summarizing  the 
simulation  results,  v;e  will  at  times  refer  the  reader  to  these  tables. 
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Parameters: 


TABLE  4.2 


SIMULATION  STUDY 

ERROR  MODEL  1:   Z  =  0Z   ^  +£ 
t     t-J    t 


(J,K) 

0 

n 

a 

(2,4) 

-.9 

50 

.05 

(3,4) 

-.7 

200 

(4,4) 

-.5 

(5,4)'-= 

-.3 

(2,12) 

-.1 

(3,12) 

0 

(4,12) 

.1 

(12,12) 

.3 

(12,24) 

.5 
.7 
.9 

i^'NOTE:   Powers  are  generated  for  all  of  the  above  combinations  of 
{(J,K)  0,  n,  a}  with  the  excpetion  of  the  case 
{(5,4),  0,  200,  .05}. 
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TABLE  4.3 


SIMULATION  STUDY 


ERROR  MODEL  2:   Z  =0,Z   ,  +0,Z   ,  +e 
t    J,  t~Ji    J 2   t-J 9    1 


Parameters:       (J^,J^;K) 


^.j^.k;     i^J,'>"J2 


(1,2;2)      (-.5, .3)       50       .05 
(1,2;12)     (.5,  .3)      200 
(-1.0.-. 6) 
(1.0,-. 6) 
(.l,-.7) 
(.l,.7) 
(-.3,.l) 
(.7, .3) 
(-.7, .3) 

(1,3;4)     (.l,-.9)        50       .05 


(.l,-.9) 

50 

(.1..7) 

200 

(.5,-1.2) 

(-.5,-. 3) 

(1.0, .1) 

(-1.0,. 1) 

(.5,-. 3) 

(-1.0, .3) 

(.3,-.l) 

SI 


POWER  SIMULATIONS  ERROR  MODEL 
J=2,K-4 
1.0  r 


.9  - 


O 
II 

cr 

LU 

o 

Q_ 


.7 


.4 


-.9    -.8    -.7   -.6   -.5    -.4    -.3  -.2     - 
LAG    PARAMETER  {(p) 


0 


FIGURE  A. la 
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POWER  SIMULATIONS  ERROR  MODEL 
J=2,K=4 

1 .0  r  ^^zr^—- 


o 

II 

o 
en 

o 

Q_ 


n  =  50 

_t(bp) 

n  =  200 

_t(bp) 

._- j(M) 

J I I L 


0     .1      .2     .3      .4     .5     .6     .7     .8     .9 

LAG    PARAMETER (^) 


FIGURE  4.1b 
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POWER  SIMULATIONS  ERROR  MODEL 
J=4,K=4 
1.0  r 


in 
O 


.8 


.7 


.6 


II 

rj 

.b 

cr 

LU 

^ 

o 

.4 

Ql 

.3 

2 

-.9    -.8    -.7   -.6   -.5    -.4    -.3  -.2    - 
LAG    PARAMETER  [cf^) 


0 


FIGURE  4.2a 
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POWER  SIMULATIONS  ERROR  MODEL 
J=4,K=4 

1.0  r 
.9 


.8 


q    -6 
II 

a 

^     .5  1- 
q: 

LU 

I     .4 

CL 

.3 
.2 


0     .1      .2     .3      .4      .5     .6     .7     .8     .9 
LAG    PARAMETER  {4^) 


FIGURE   4.2b 
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POWER  SIMULATIONS  ERROR  MODEL 
J=2,K-12 
1.0  r 


.9   -.8    -.7   -.6   -.5    -.4    -.3  -.2    - 

LAG    PARAMETER  (c^) 


FIGURE  4.3a 
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POWER  SIMULATIONS  ERROR  MODEL 
J  =  2,KH2 

1.0  - 
.9  - 


.8 


LO 

O 

.b 

II 

o 

^ — 

.5 

cr 

LU 

^ 

o 

.4 

CL 

0     .1      .2     .3      .4     .5     .6     .7     .8 
LAG    PARAMETER  (<^) 


.9 


FIGURE  4.3b 
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POWER  SIMULATIONS  ERROR  MODEL 
J=I2,K=24 
1.0  r 


o 

II 

o 

q: 
u 

o 

Q_ 


.9    -.8    -.7   -.6   -.5    -.4    -.3  -.2    -I       0 
LAG    PARAMETER  ((/)) 


FIGURE   4.4a 


POWER  SIMULATIONS  ERROR  MODEL 
J  =  I2,K-24 


_t(bp) 

n 

=  50 

_t{m) 



_t(bp) 

n  = 

200 

._j(M) 

.2     .3      .4      .5     .6     .7     .8 
LAG    PARAMETER  {4>) 


FIGURE   4.4b 
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POWER  SIMULATIONS  ERROR  MODEL 
J  =  5,K=4 
,.0. 


.9 


.8 


LO 

o 


.6 


.9    -.8    -.7   -.6   -.5    -.4    -.3  -.2    -.1      0 
LAG    PARAMETER  ((^) 


FIGURE  4.5a 
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POWER  SIMULATIONS  ERROR  MODEL 
J=5,K-4 
1.0  r 


LAG    PARAMETER  (s^) 


FIGURE   4.5b 
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We  first  discuss  the  power  simulation  results  for  error  model  1 
(see  Tables  A-1  -  A-9  in  Appendix).   Note  that  for  n=50.  Figures  4.1  - 

4.4  show  that  moderate  and  large  values  of  the  lag  parameter  (in  absolute 
value),  i.e.,  .5  -  |0|  -  1,  lead  to  a  high  rate  of  rejection  of  the  null 
hypothesis  of  white  noise  for  both  the  Box-Pierce  and  max-x^  tests.   VJhen 
the  sample  size  is  increased  to  200,  high  rejection  rates  result  at  values 
of  the  lag  parameter  .3  or  larger  (in  absolute  value).   Except  for  the 
case  J=5,  K=4  (Figure  4.5),  these  results  hold  for  all  other  cases  con- 
sidered.  For  these  models,  then,  this  simulation  study  clearly  supports 

our  supposition  that  both  tests  attaiii  high  power  under  a  general  alternative, 
Compare  now  Figure  4.1  and  4.3,  i.e.,  the  cases  J=2,  K=4  and  J=2,  K=12. 
Notice  that  the  powers  of  the  tests  generally  decrease  as  K,  the  number  of 
autocorrelations  included  in  the  test  statistic  is  increased  from  4  to  12. 
And  in  all  other  cases  considered,  for  a  fixed  lag  J,  the  powers  of  the 
tests  decreased  as  K  increased.   In  contrast,  if  the  researcher  unknowingly 
selects  K  less  than  the  smallest  nonzero  lag  in  the  model  (J  in  our  model) , 
the  powers  of  the  tests  are  reduced  dramatically,  as  demonstrated  in  Figure 

4.5  for  the  case  J=5,  K=4.   For  moderate  and  small  values  of  the  lag  para- 
meter, the  powers  of  the  tests  are  less  than  .10.   Thus,  the  test  user's 
choice  of  K  is  a  delicate  one.   The  researcher  v/ho  conservatively  selects 
a  K  much  larger  than  the  largest  nonzero  lag  in  the  general  alternative 
erro-  model  will  fail  to  reject  the  null  hypothesis  of  white  noise  when 
serial  correlation  exists  at  a  more  frequent  rate.   Alternatively,  if  K 

is  chosen  sm,aller  than  the  lowest  lag  in  the  hypothesized  error  model, 
the  tests  have  very  low  power. 

Comparing  tlie  powers  of  the  tests.  Figures  4.1a  -  4.4a  reveal  that 
the  power  of  the  max-);   procedure  dominates  the  power  of  the  Box-Pierce 
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test  for  almost  all  negative  values  of  the  lag  parameter,  or  more 
specifically,  for  0  -  .3.   Consider  the  case  J=12,  K=2A  (Figure  A. A). 
Referring  to  Table  A-8  in  the  Appendix,  at  0  =  -.7  and  n=50,  the  max-x^ 
test  with  a  simulated  power  of  .853  greatly  outperforms  the  Box-Pierce 
test  (simulated  power  of  .583).   \^^len  analyzing  yearly  data,  of  course, 
it  is  very  possible  that  the  regression  errors  {Z  }  follow  an  auto- 
regressive  scheme  with  nonzero  lag  12.   Thus,  the  practical  significance 
of  the  result  is  clear.   For  small  values  of  the  lag  parameter,  i.e., 
-.3  -  0  -  .3,  the  figures  show  that  the  Box-Pierce  power  is  generally 
larger  than  the  max-x^  power.   However,  this  result  seems  much  weaker 
than  that  previously  stated  since  the  powers  attained  by  both  tests 
for  0  in  this  range  are  very  low,  and  in  some  cases,  near  zero.   The 
apparent  trend  in  the  powers  of  the  tests  for  moderate  and  large  values 
of  the  lag  parameter  at  n=50  can  be  stated  as  follows:   (a)  for  .3  -  0  -  .5, 
the  powers  of  the  tests  are  very  nearly  equivalent;  (b)  for  0  -  .5,  the 
power  of  the  max-x^  test  is  slightly  higher  than  the  Box-Pierce  power. 
The  max-x^  procedure  also  seems  to  be  less  sensitive  to  an  increase  in  K. 
For  example,  compare  Figures  A.l  and  A. 3,  the  cases  J=2,  K=A  and  J=2,  K=12. 
At  0  =  .3  and  n=200  the  Box-Pierce  power  drops  from  .9A7    (Table  A-1)  to 
.837  (Table  A-A),  while  the  drop  in  the  power  of  the  max-x^  test  is  only 
from  .959  to  .925. 

Figure  A. 5  represents  the  only  case  (J=5,  K=4)  in  which  the  Box- 
Pierce  test  clearly  outperforms  the  max- x^  test.   In  this  in  tance,  we 
expect  both  tests  to  perform  poorly.   With  J=5,  the  first  four  true 

autocorrelations  p,  ,  p„,  p„,  p,  are  zero,  and  thus  each  of  the  first 
1    2    3    A 

four  sample  autocorrelations  r  ,  r  ,  r„,  r   estimate  a  quantity  known 

to  be  zero.   Hence,  both  the  sum  and  the  maximum  of  the  first  four  sample 
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autocorrelations  will  be  small  and  will  rarely  lead  to  a  significant 
result.   The  only  reason  that  the  two  tests  obtain  any  power  at  all 
(i.e.,  power  greater  than  .05)  is  due  to  v..,  the  variance  of  the 

asymptotic  distribution  of  /nr . ,  i  =  1,  2,  3,  4.   From  Section  3.3.3, 

1+02 
equation  (3.3.9)  gives  v..  =  -  ^^  >  i  =  1>  2,  3,  4,  for  the  case  J=5, 

K=4.   As  the  magnitude  of  0  increases,  v..  also  increases.   Thus,  even 
if  p .  =0,  a  large  value  of  0  could  possibly  lead  to  large  values  of 
r.  due  to  random  variation,  and  hence,  a  significant  result.   This 
unusual  phenomenon  v;ill,  of  course,  occur  more  often  when  using  the 
Box-Pierce  test,  since  the  variability  of  the  sum  of  the  first  four 
sample  autocorrelations  will  be  larger  than  the  variability  of  the  max- 
imum.  However,  it  should  again  be  noted  that  the  Box-Pierce  test,  while 
outperforming   the  max-x   test,  attains  a  very  low  and  unappealing  power. 

A  final  point  to  be  made  is  that  for  all  cases  considered  in  this 
part  of  the  study,  the  powers  of  the  tests  appear  to  be  very  low  (near  0) 
for  values  of  the  lag  parameter  near  0.   However,  one  must  remember  that 
the  critical  regions  used  in  this  study  were  those  asymptotic  regions, 
discussed  in  Section  3.3.   In  theory,  when  0=0,  the  power  of  the  test 
and  significance  level  (a)  of  the  test  are  identical.   But  a  study  of 
the  n=50  results  for  0  =  0  in  Tables  A-1  -  A-9  of  the  Appendix  reveals 
that  the  majority  of  the  simulated  powers  are  smaller  than  .05.   Thus, 
the  actual  level  of  the  test  at  n=50  is  less  than  the  asymptotic  level 
(.05)  used  in  the  study,  which  in  turn  makes  the  power  small  for  0  near 
0.   Notice  that  when  n  is  increased  to  200,  powers  at  0  =  0  are  very 
close  to  .05,  which  indicates  that  the  asymptotic  level  of  the  test 
statistics  apparently  have  been  attained. 
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Summarizing  the  main  results  for  model  1: 

(i)   For  moderate  to  large  negative  values  of  the  lag  parameter, 
the  power  of  the  max-x^  test  dominates  the  power  of  the  Box- 
Pierce  test, 
(ii)   For  -.1  -  0  -  .1,  the  tests  have  very  low  power, 
(iii)   In  most  cases,  vjhen  0  -  .3,  the  max-x^  test  outperforms  the 
Box-Pierce  test, 
(iv)   The  max-x^  test  appears  to  be  less  sensitive  (in  terms  of 
power)  to  changes  in  the  number  of  sample  autocorrelations 
included  in  the  test  statistic. 
(v)   \"Jhen  the  number  of  sample  autocorrelations  K  is  chosen  less 
than  the  smallest  nonzero  lag  J  both  tests  attain  a  very 
low  power. 
These  results  are  not  surprising,   for  model  1  is  the  type  of  alternative 
(one  with  few  nonzero  lag  parameters)  under  which  we  hypothesized  that 
the  Box-Pierce  procedure  would  frequently  fail  to  reject  the  null  hypothesis 
of  white  noise  (see  Section  3.2). 

A  close  examination  of  the  simulated  powers  for  model  2  reveals  no 
discernable  trend.   Thus,  we  omit  power  curves  for  these  cases.   For 
versions  of  model  2  considered,  the  observed  difference  in  the  powers 
of  the  two  tests  never  exceeds  .042  (see  Tables  A-10  -  A-12  of  the 
Appendix).   Although  it  appears  that  the  Box-Pierce  test  and  max-x^  test 
attain  approximately  the  same  poiv'er  for  these  second  order  models,  one 
should  not  assume  that  the  powers  will  be  identical  for  all  second  order 
models.   A  more  extensive  simulation  study  needs  to  be  undertaken. 

As  previously  stated,  the  regression  errors  {Z  1  in  any  practical 
case  will  be  unobservable.   In  the  following  section,  we  examine  the 
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simulated  powers  of  the  two  tests  when  the  test  statistics  are  computed 
using  residuals  calculated  from  least  squares  regression. 
4.1.2  Estimated  Residuals  After  Regression 

Recall  the  problem  (stated  in  Section  1.1)  of  incorrectly  applying 
least  squares  Inferential  methodology  to  the  parameters  of  the  regression 
model: 

Y,  ,,  =  X,   .  '3,  ,.  +  Z,  ,,    ,  (4.1.3) 

- (nxl)     (nxg)  ~ (gxl)    ~ (nxl) 

where  Z^ ,  Z„,  .  .  .,  Z  are  unobservable  random  errors.   In  order  to 

utilize  the  Box-Pierce,  max-x^  ,  or  Durbin-Watson  d  procedure  as  a  test 

for  independence  of  the  {Z  }  ,  the  researcher  must  first  compute  the 

vector  of  least  squares  residuals  Z  =  (Z-.  ,  Z  ,  .  .  .,  Z  )  ,  where 

Z  =  Y  -  X-3 
and 

3  =  (X'X)~^X'Y 
These  residuals  are  then  substituted  for  {Z  }  in  the  formulas  for  the 
test  statistics,  i.e., 

T 


1=1  -^ 


T     =  n  max  r  / 


where 


and 


^t^j+l't  h-P^^t^l'-P      ' 


a   = ;; 


Our  power  simulations,  in  this  regression  case,  now  require  additional 
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steps  to  those  given  in  Section  4.1,  for  there  are  two  models  to 
consider:  the  general  regression  model  (4.1.3)  of  interest  and  the 
autoregressive  pattern  of  the  random  errors  under  the  alternative 
hypothesis  of  dependence  (4.1.1).   We  outline  the  simulation  technique 
in  Tabl e  4.4. 

Four  regression  models  are  considered  in  this  study. 

MODEL  A:   Y^  =  B^  +  B  t  +  Z   ,      t  =  1,  2,  3,  .  .  . ,  n 


MODEL  B:   Y^  =  B^  +  B^t  +  &^t'^   "^  ^t'    t  =  1,  2,  3, 


,  n 


t  =  1,  2,  3, 


MODEL  C:   Y  =  B  +  B-,X  +  B^t  +  Z 
t    o    it    Z     t 

\  =  ^o  ■*-  ^l\-l  ■"  \    ' 

where  (n  }~  iid  N(0,1)  and  |y,I  <  1 

MODEL  D:   Y^  =  B  +  B.X^  +  B^X^,  +  Z,  , 
t    o    1  It    Z   It  t 


It 


%  +  "A,t-l  +  ^t' 


^2t  =^o  +  YiX2^^_^  +  a)2^  , 


where  |a  |<  1,  IyJ  <  1  and  w  =  (w,  ,  f^^t^'  ~  '^'^{0, 


1  P 
0     1 


Powers  of  the  Box-Pierce,  max-x  ,  and  Durbin-Watson  d  test  are  simulated 
for  each  regression  model  under  the  first  order  lag  J  AR  alternative: 

h   =  ^^t-J  +  ^t   ' 

that  is,  model  1  of  Section  4.1.1.   Also  estimated  is  the  probability 
that  the  d  statistic  falls  in  the  "inconclusive"  region  (Section  1.2.1). 
Our  format  for  presenting  the  simulation  results  is  similar  to  that  of 
the  previous  section.   Tables  of  the  parameter  values  for  each  regression 
model  are  followed  by  power  curve  figures  v/hich  are  typical  of  the  cases 
considered.   We  again  include  all  numerical  poxv?er  results  in  table  form 
in  the  Appendix. 
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TABLE  4.4 
IIONTE  CARLO  SIMULATION 

REGRESSION  MODEL:   Y^  =  3  +  B^X, ^  +  3_X„^  +  .  .  .  +  g  X  ^  +  Z^ 
t    o    1  it    2  2t  g  gt    t 

AJ.TER^^ATIVE  ERROR  MODEL:   Z  =  0-,  Z^_^  +  ^^^_2   +  •  •  •  +  0  ^^   "^  ^t' 

where  {e  }  is  white  noise. 

STEPS  1-5:   Same  as  previously  given  in  Table  4.1. 

STEP  6:   Use  the  generated  random  errors  {Z  }  from  Step  5  tc  obtain 

simulated  values  of  the  observable  random  variables  (Y  }  from  the 

regression  model  (4.1.1).   (Assume  B  ,  B,  ,  •  •  •,  B   are  kno^m,  and 
o  '  o   1  g 

use  these  values  to  compute  Y  ). 

STEP  7 :   Apply  the  method  of  least  squares  to  the  regression  model  (4.1.1) 
in  order  to  obtain  3. 

STEP  8:   Compute  the  vector  of  least  squares  residuals  Z. 

STEP  9:   Use  the  simulated  estimates  of  the  random  errors  to  obtain  estimates 
of  the  first  K  sample  autocorrelations  r  ,  r„,  .  .  .,  r  . 
STEP  10:   Compute  the  three  test  statistics  T^   ,T  ™  and  d.   Determine 
whether  the  calculated  values  of  the  test  statistics  fall  in  their  re- 
spective rejection  regions: 


rj,  (m)> 


K,a 
A\  ^    (1-a)^/^ 


d  <  d"     or  d  >  4-di':   ,„  (whf^re  d^'   ,„  depends  upon 
L,a/2  L,a/2         L,a/2 

n-g  and  may  be  obtained  from  available  D-W  tables). 
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TABLE  4.4— Continued 

STEP  11:   Repeat  steps  1  -  10  N  times  (we  used  N=1000  iterations) 
STEP  12:   Compute  the  simulated  power  for  each  test  as  follows: 

„       number  of  reiections 

Power  = 

1000 
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Before  presenting  the  results,  we  note  the  sources  for  some  of  the 
model  parameters  used  in  the  study.   The  regression  coefficients  for 
model  B  were  obtained  from  Durbin-Watson  [10]  ,  where  the  annual  price 
of  sugar  Y  was  regressed  over  time.   Regression  model  C  is  similar  to 
the  model  studied  by  Fuller  [13]  ,  pp.  444,  where 

Y   =  the  logarithm  of  employment  (in  thousands)  of  the  cement  industry, 

X  =  the  logarithm  of  the  production  index  of  the  industry, 
t  =  time  in  quarters. 
A  model,  first  discussed  by  Durbin-Watson  [10]  and  later  by  Fuller  [13], 
pp.  426,  that  attempts  to  explain  the  annual  per  capital  consumption  of 
spirits  (Y  )  using  the  independent  variables  per  capita  income  (X  )  and 
price  of  spirits  (X„  )  is  similar  to  our  regression  model  D,   The  inclusion 
of  model  D  enables  us  to  examine  the  behavior  of  the  residuals  when  the 
independent  variables  (X,  ,  X   )  are  highly  correlated. 

(The  power  simulation  results  for  all  cases  considered  in  this  section 
are  given  in  Tables  A-13  -  A-28  of  the  Appendix.)   The  trend  in  the  powers 
of  the  Box-Pierce  and  max-x^   test,  as  piectured  in  Figures  4.6  -  4.8,  is 
almost  identical  to  the  non-regression  case.   Except  for  small  positive 
values  of  the  lag  parameter  0,  the  max-x^   power  dominates  the  Box-Pierce 
power.   Again,  for  fixed  J,  the  performance  of  the  max-x^   procedure  appears 
to  be  less  sensitive  to  an  increase  in  K  (see  tables  in  the  Appendix). 
The  pov;ers  of  the  Box-Pierce  and  max-x^"   test  are,  once  mora,  near  zero 
for  small  values  of  the  lag  parameter.   At  n  =  50,  the  actual  levels 
of  the  tests  are  less  than  the  asymptotic  level  (.05). 
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TABLE  4.5 


SIMULATION  STUDY 

REGRESSION  MODEL  A:   Y^  =  3  +  B, t  +  Z^ 
t    o    1     t 

ERROR  MODEL  1:   Z  =  0Z  _  +  e 


Paracieters:      (J,K)       0        n       a        o      1^ 

(2,4)      -.9      50      .05      .4      4.4 

(3,4)      -.8 

(4,4)      -.7 

(1,12)     -.6 

(4,12)     -.5 

-.4 

-.3 

-.2 

-.1 

0 

.1 

.2 

.3 

.4 

.5 

.6 

.7 
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TABLE  4.6 


SIMULATION  STUDY 

REGRESSION  MODEL  B:   Y  =  B  +  B^ t  +  B„t2  +  Z 

t     o  1      2       t 

ERROR  MODEL  1:   Z  =  0Z  ,  +  e 


Parameters:       (J,K)       0        n       a 


(4,4)      -.9      50      .05    21.548  -.2544   .05727 

(1,12)     -.8 

(4,12)     -.7 

-.6 

-.5 

-.4 

-.3 

-.2 

-.1 

0 

.1 

.2 

.3 

.4 

.5 

.6 

.7 


.9 
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TABLE  4.7 


SIMULATION  STUDY 


REGRESSION  MODEL  C:   Y   =3  +  B,X  +  ^^t  +  Z 
t    o    It    /     t 

X  =  Y   +  YtX^  1  +  n^,  {  n^}  white  noise 
t    o    1  t-1     t    t 

ERROR  MODEL  1:   Z   =  0Z   ,  =  e 
t     t-J    t 

Parameters:     (J,K)      0       n       a      ^o       1       2 

(2,4)     -.9     50      .05    .84     .098   -.00057 
(4,4)     -.8 

(1,12)    -.7  ^o      ^1 

(4,12)    -.6  .8      .8 

-.5 

-.4 

-.3 

-.2 

-.1 

0 

.1 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.9 
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TABLE  4.8 


SIMULATION  STUDY 

REGRESSION  MODEL  D:   Y   =3  +  B,X,   +  6^>'   + 
t    o    1  It     2  2t 


It 


2t 


"o  +  ^^2,t-l  +  '^2t 


where  (w   ,w   )' 


ERROR  MODEL  1: 


:  =  0Z   ,  +  c 
t     t-J    t 


"^  0, 


Parameters ; 


(J.K) 

(2,4) 

(4,4) 

(1,12) 

(4,12) 


-.7 

-.6 

-.5 

-.4 

-.3 

-.2 

-.1 

0 

.1 

.2 

.3 

.4 

.5 

.6 

.7 


50 


.05 


2.14 


.69   -.63 


-.5 
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POWER  SIMULATIONS  REGRESSION  MODEL  A 
J=2,K=4 


1.0- 


LAG    PARAMETER  (c;6) 


FIGURE  4.6a 
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POWER  SIMULATIONS  REGRESSION  MODEL  A 
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FIGURK  4.6b 
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POWER  SIMULATIONS  REGRESSION  MODEL  B 
J=  I  ,K  =  12 
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FIGURE   4.7a 
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POWER  SIMULATIONS  REGRESSION  MODEL  B 

J=  I  ,K-I2 
1.0  r 
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LAG    PARAMETER  {4^) 


FIGURE  4.7b 
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POWER  SIMULATIONS  REGRESSION  MODEL  D 
J  =  4,  K-12 
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FIGURE  A.Sa 
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POWER  SIMULATIONS  REGRESSION  MODEL  D 
l.Or  J  =  4,K=12 
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FIGURE   4.; 
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The  Durbin-Watson  d  test  offers  a  very  intersting  set  of  results. 
Wiile  the  power  curves  for  the  Box-Pierce  and  max-x^  tests  depicted  in 
Figures  4.6  -  4.8  remain  virtually  unchanged,  the  power  curves  for  the 
d  test  are  very  diversified.   Consider  first  the  case  J=l,  K=12  (Figure 
4.7).   In  this  instance,  the  power  of  the  d  test  clearly  dominates  the 
powers  of  both  the  other  tests  for  all  values  of  0.   This  is  to  be 
expected,  however,  since  the  d  statistic  essentially  reduces  to  r^,  the 
sample  first  order  autocorrelation  function  (Section  3.1).   We  have  seen 
that  r   is  sufficient  for  p  ,  and  hence  0   (Lemma  15).   Figure  4.8 
displays  the  tremendous  loss  in  the  d  test's  power  when  J  increases  to 
4.   For  almost  all  values  of  0  in  the  case  J=4,  K=12,  the  power  of  the 
d  test  is  .1  or  lower,  while  the  maximum  power  attained  by  the  test  is 
.3  (see  Table  A-28  of  the  Appendix).   However,  it  is  when  J=2  (Figure 
4.6)  that  the  power  trend  of  the  d  test  makes  its  most  dramatic  change. 
For  every  other  case,  the  power  of  the  d  test  increases  as  the  lag 
parameter  0  increases  in  absolute  value.   In  the  case  J=2,  K=4 ,  though, 
the  d  test  has  essentially  no  power  (power  close  to  zero)  for  large 
negative  values  of  0  and  attains  an  atypical  high  power  of  .703  when  0  = 
.9  (Table  A-13) .   This  abrupt  change  in  the  power  pattern  can  be  partially 
explained  by  investigating  the  asymptotic  distribution  of  v  n  r ^^  when 
J=2.   Recall  from  Theorem  1  that  the  variance  of  the  asiTnpcotic  distribu- 
tion  of  Vn  r   is  v^.^^  =  1-0  ^   '      ^^   ^   increases,  v^^  also  increases. 
Hence  for  large  negative  values  of  the  lag  parameter,  the  asymptotic 
variance  of  /n  r  will  be  small,  and  since  p   =  0  for  this  case,  /n  r^ 
or  d  will  vary  over  a  small  range  centered  at  0.   Thus,  the  computed 
value  of  d  will  rarely  fall  into  the  critical  region  when  0  is  large 
and  negative.   However,  for  large  positive  0,  the  reverse  is  true.   The 
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d  statistic  will  vary  over  a  large  range  centered  at  0,  leading  to  larger 
computed  values  and  a  higher  rejection  rate.   A  quick  glance  at  the  last 
column  of  Tables  A-13  -  A-28  in  the  Appendix  reveals  that  the  rate  at 
which  the  d  statistic  falls  into  the  "inconclusive"  region  is  relatively 
small  for  all  cases.   This,  again,  is  to  be  expected,  since  n-g  is  large 
(either  48  or  49,  depending  on  the  regression  model) . 

Overall,  the  different  regression  models  have  very  little  effect  on 
the  general  power  trends  of  the  tests.   Hov/ever,  a  comparison  of  the 
results  of  regression  reveals  the  following:   for  negative  values  of  the 
lag  parameter,  the  powers  of  the  Box-Pierce  and  max-X   tests  are  generally 
higher  when  the  test  statistics  are  calculated  using  regression  residuals; 
for  positive  values  of  the  lag  parameter  the  reverse  is  true,  that  is, 
the  powers  of  the  tests  are  generally  higher  when  the  test  statistics  are 
calculated  using  the  "observable"  residuals.   This  result  is  due  in  part 
to  the  bias   Introduced  by  the  application  of  the  least  squares  regression 
and  is  best  explained  in  the  following  sequential  manner: 

(i)   For  positive  values  of  0,  the  actual  variability  of  the 

least  squares  estimator  3  is  larger  than  indicated  by  the 

least  squares  variance  formulae  (see  Section  1.1). 
(ii)   Since  the  vector  of  least  squares  residuals  Z  is  computed 

from  3,  the  residual  variances  are  larger  than  would  be 

expected  in  the  white  noise  case. 
(iii)   As  a  consequence  of  (ii),  the  sample  autocorrelations  computed 

from  the  least  squares  residuals  also  tend  to  have  larger 

variances , 
(iv)   The  Box-Pierce  and  m.ax-X   statistics  have  non-null  distributions 

centered  away  from  0  when  0  is  nonr.ero.   Tlius ,  the  tests  will 
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fail  to  reject  the  hypothesis  of  white  noise  (0  =  0)  when  in 
fact  the  alternative  is  true  (0  5*  0)  only  if  random  variation 
causes  the  test  statistics  to  fall  in  their  respective  lower 
tail  areas, 
(v)   The  larger  variability  of  the  sample  autocorrelations  (ii) ,  of 
course,  increase  the  variances  of  both  the  Box-Pierce  and  max- 
X   test  statistics.   The  chance  of  random  variation  giving 
rise  to  "small"  values  of  the  test  statistics  is  in  turn 
greater,  which  leads  to  a  less  powerful  test. 
For  negative  values  of  0,  (i)  through  (v)  hold  in  reverse,  and  the  tests 
become  more  powerful  in  the  regression  case. 

The  main  results  of  the  simulation  study  for  the  regression  case  are 
summarized  as  follows: 

(i)   The  power  trends  detected  for  regression  models  A,  B,  C  and  D 
are  essentially  the  same. 
(ii)   The  power  of  the  max-x^  test  dominates  the  power  of  the  Box- 
Pierce  test  for  all  negative  and  moderate  to  large  positive 
values  of  the  lag  parameter  0. 
(iii)   The  power  of  the  Box-Pierce  test  is  slightly  larger  than  the 

power  of  the  max-x   test  when  0  is  positive  and  small,  although 
both  tests  have  low  power. 
(iv)   The  Durbin-Watson  d  test  outperforms  both  the  Box-Pierce  and 
max-x^  tests  under  a  first  order  lag  1  alternative. 
(v)   Both  the  Box-Pierce  and  laax-x   tests  outperform  the  d  test 
for  those  first  order  alternatives  v/ith  lag  larger  than  1. 
Since  the  first  order  AR  scheme  with  lag  1  represents  a  very  common  and 
?ience,  a  very  important  residual  error  model  in  practice,  and  since  the 
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Durbin-VJatson  d  test  attains  a  very  high  power  in  this  case,  we  recommend 
that  the  practical  researcher  always  apply  the  Durbin-Watson  procedure 
as  a  test  for  serial  correlation  of  the  errors  of  a  regression  model. 
However,  the  d  test  should  be  supplemented  by  another  test  which  has 
high  power  against  more  general  alternative  error  models.   From  our 
simulation  study,  v/e  have  seen  that  both  the  Box-Pierce  and  max-x   tests 
make  excellent  candidates.   But  the  max-x^  test  appears  to  be  the 
better  supplemental  test  if  a  low  order  model  is  expected,  for  our 
results  consistently  show  the  dominance  of  the  max-x   power  over  the 
Box-Pierce  power  in  this  case. 

A. 2  Power  Approximations  for  Large  Samples 
Our  final  goal  of  the  simulation  study  is  to  compare  the  simulated 
powers  of  the  Box-Pierce  and  max-x   tests  to  the  large  sample  power 
approximations  derived  in  Section  3.3.   Recall  that  our  method  of 
approxim.ating  the  max-x^  power  was  to  use  a  Taylor-series  expansion  of 
the  asymptotic  joint  density  function  of  the  first  K  sample  autocorrela- 
tions.  The  expansion  is  given  in  equation  (3.3.27)  of  Lemma  12.   We 
considered  three  different  methods  for  approximating  the  pox/er  of  the 
Box-Pierce  test:   (a)  Irahoff  numerical  integration,  (b)  Imhoff  extension 
to  the  Pearson  three-moment  approximation,  and  (c)  Rao  asymptotic  normal 
square  root  transformation.   These  approximations  to  the  Box-Pierce  power, 
P{T     >  C    }  ,  are  expressed  as  follows  (for  details,  see  Section 
3.3.3.2.1): 


■^-^ — y~ —  du  ,    v/here  the  functions  G(u)  and  p  (u) 
up  (u) 


are  given  by  equation  (3.3.18)  of  Theorem  7. 


b.    P{x^(0)  >  C"}  ,  where  h  and  C-''  are  defined  in  equation  (3.3.19) 
of  Theorem  8. 
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1_$ 


■V^-/n-(p'pV 


+$ 


■-^-v^(p'p)^ 


(  (p'p>  ^(p'vp)^  j    |_(p'p)  ^(p'vp)'   3 

where  p  and  V  are  the  asymptotic  mean  vector  and  asymptotic 
covariance  matrix,  respectively,  of  the  first  K  sample 
autocorrelations , 
For  this  part  of  the  study,  we  consider  three  versions  of  error  model  1: 
(J=2,  K=4),  (J=3,  K=4)  and  (J=4,  K=4) .   In  order  to  apply  the  approxima- 
tions, we  must  derive  the  asymptotic  mean  vector  /n  p  and  covariance 
matrix  V  of  the  first  four  sample  autocorrelations  in  each  case.   Recall 
from  Theorem  2  of  Section  3.3.3  that  the  eigenvalues  of  V,  their  respective 
orders  of  multiplicities  and  certain  linear  combinations  of  the  elements 
of  p  all  contribute  to  the  power  expressions  for  the  Box-Pierce  approxima- 
tions and  raax-x^  approximations.   In  the  follov;ing  subsections,  we  give 
/n  p  and  V  for  each  of  the  three  cases,  and  also  the  Taylor-series  approx- 
imation to  the  max-x   power.   We  then  use  these  results  to  compute  the 
power  approximations. 
4.2.1  Case:   J=4,  K=4 

We  initially  considered  the  case  (J=2,  K=4)  in  Section  3.3.3.2. 
Recall  that  the  asymptotic  mean  vector  and  covariance  matrix  of  vn  r  = 
vn  (r  ,  r„,  r  ,  r  )^   are  as  follows: 


V  = 


/iTp  =  v^  (0,  0,  0,  02) 


(1+0) 2     .      20+30!z0^ 


1-t 
0      l-!( 


20+302-0 


l-( 


7^   0     1+0-^+40^-20 


2j./,  rt3_ort5 


0     20(1-02)      0 


20(1-0  ) 


1+02-30'' 
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The  Taylor-series  approximation  to  the  max-x^  power  is  given  by  equation 
(3.3.29)  of  Theorem   9. 
4.2.2  Case:   J=3,  K=4 

Substitute  J=3  in  equation  (3.3.4)  of  Lemma  4  and  equations  (3.3.9) 
and  (3.3.10)  of  Theorem  4  to  obtain  the  asymptotic  mean  vector  and  co- 
variance  matrix  of  /n  r : 

v^p  =/n  (0,  0,  0,  0)'  , 


V  = 


1+02     20 
1-0-    1-0-= 


l-i 


20    1+02     Q   302-0^ 


l-i 


1_07   1307 
0      0     1-02    0 

1+02 


20   302-0 


2_fSU 


l-i 


l-i 


0 


1-! 


^ 


The  Taylor-series  expansion  approximation  to  the  max-x   power  is, for  this 
case, given  by  the  following  theorem. 

Theorem  11:   A  Taylor-series  approximation  to  the  asymptotic  power 
of  the  max-x2  test  for  the  case  (J=3,  K=4)  is  obtained  by  computing: 

l-[q>(b3)-^(a^)]-{[2^(b^)-l]3+-|[2o(b^)-l][4b2^2(i^_^)][2c2+c2]     (4.2.1) 

+  -|[-8b3(;)3(b^)][c2c2]+  j^   ([2^(b^)-l][4(b3-3b^)2^2(b^)][2c!^+Cp 

+  [-8(b£-3b^)b2(h3(b^)][C^+2c2c|])  +  j|^[-8(b3-3b^)b2v^3(b^)][2qC2+c2c3] 

+  ^([2<5(b^)-l]  [4(b5-10b3+15b^)2^2  (b^)  ]  [2C5+C^] 

+    [-8(b5-10b3+15b^)  (b3-3b^)b^({)3  (bj^)  ]  [2C5+2C^C2+2C2C^] 

+    [-S(b3-3b^)3(^3(bJ[cJc22])}       , 
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where  (})  (x)  = 


/27 


vOBpy 


b,  =  ,  b 


,   $(x)  =  j  M 

^7^)  -v^0 


20 


302-0' 


z)dz    ,   C^  -  3j^  ,   C^  -   ^-0. 


/TCbpT 


-  "C^^^''  -/^ 


^   /i+0^ 


*^r^ 


/i^ 


Proof:   Follows  the  proof  of  Theorem   9. 
4.2.3  Case;   J=4,  K=4 

Apply  Lemma  4  and  Theorem  4  to  obtain 
/n  p=  /n(0,  0,  0,  0)'  , 


D 


1+02 
1-02 

0 

20 
1-02 

0 

(1+0)  ' 
1-0 

0 

20 
1-0^ 

0 

1+02 
1-02 

0 

0 

0 

0 
0 

0 

1-02 


the  mean  vector  and  covariance  matrix,  respectively,  of  the  asymptotic 

distribution  of /n  r  =  /ri(r_  ,  r„,  r„,  r,)'when  J=4 .   From  Lemma  12,  we 

12    3   4 

derive  the  Taylor-series  approximation  to  the  max-x^  power,  and  give 
the  result  as  a  theorem. 

Theorem  12;   A  Taylor-series  approximation  to  the  asymptotic  power 
of  the  max-x   test  for  the  case  (J=4,  K=4)  is  ohtained  by  computing: 

l-[<D(b^)-5Ka^)][2$(b2)-l]{[2$(bj^)-l]2+  ■|[c2][4b2<,2(b^)]       (4.2.2) 

+  -2f-[4(b3-3b^)2<j)2(b^)C^]  +  ^[4(b^-10b3+15b^)2<^2(b^)][c5] 

+  g7[4(b7-21b5+105b3-105b^)2(^2(b^)][c8]}   , 

1   -ix2  _  .    P,  ,„.  .  .    20 


where  <^  (x)  = 


,0(x)  =  /  <}.(Z)d2:  , 
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b^  =  -^ ,   b,  =  -^ ,  b  =  -^ 

^  /1+F  1+0  /O^ 


-^c^^^)   -/^0 


^  = 


Proof:   Follows  the  proof  of  Theorem   9.         [] 

4.2.4  Approximation  Results 

We  computed  the  power  approximations  of  both  the  Box-Pierce  and 
max-x^  tests  for  various  values  of  the  lag  parameter  0  and  the  sample 
size  n  in  each  of  the  three  versions  of  error  model  1  discussed  above. 
In  order  to  determine  the  accuracy  of  the  approximations,  we  again 
simulated  the  true  power  of  the  tests  (using  the  "observable"  residuals 
as  in  Section  4.1.1).   The  parameters  of  the  study  are  given  in  Table 
4.7.   Once  again,  we  sketch  those  power  curves  which  best  illustrate 
the  power  approximation  results,  and  refer  the  reader  to  Appendix  for 
tables  of  numerical  values. 

The  results  for  all  three  cases  are  printed  in  Tables  A-29  -  A-34 
of  the  Appendix.   Since  the  results  were  so  similar,  we  only  sketch 
power  curves  for  the  J=2,  K=4  case.   Consider  first  the  n=50  results 
for  the  Box-Pierce  approximations  (Figure  4.9).   Generally,  the  numerical 
integration  (EPl)  and  Pearson  extension  (BP2)  approximations  tend  to 
overestimate  the  simulated  power  of  the  Box-Pierce  test,  while  the  Rao 
square  root  transformation  (BP3)  tends  to  underestimate  the  power.   At 
large  values  of  the  lag  param.eter,  BP3  gives  a  slightly  better  approxima- 
tion than  BPl.   For  moderate  values  of  0,  i.e.,  .3  -  | 0|  -  .7,  the 
simulated  Box-Pierce  power  is  bounded  above  by  BPl  and  below  by  BP3. 
For  0  in  this  range,  BP2  performs  poorly.   The  BP2  approximation  seems 


118 


TABLE  4.9 

POWER  APPROXIMATIONS  FOR  THE 
BOX-PIERCE  AND  MAX-x^  TESTS 
ERROR  MODEL  1:   Z  =  0Z    +  e 


Parameters:     (J,K)      0       n        a 

(2,4)     -.9     50       .05 

(3,4)     -.8    200=^^ 

(4,4)     -.7 

-.6 

-.5 

-.4 

-.3 

-.2 

-.1 

0 

.1 

.2 

.3 

.4 

.5 

.6 

.7 


*NO±E:   For  n=200,  powers  are  approximated  only  for  odd  values  of 
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TABLE  4.10 

KEY  TO  SYMBOLS  USED  IN 
POWER  APPROXIMATION  FIGURES 


Box-Pierce:   BP(1)  =  Irahoff  numerical  integration 

BP(2)  =  Imhoff s  extension  to  the  Pearson  3-raoment 
approximation 

BP(3)  =  Rao  square  root  transformation 

BP(4)  =  Simulated  power  (no  regression) 

Max-x     :   M(l)   =  Taylor-series  approximation 

M(2)   =  Simulated  power  (no  regression) 
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POWER  APPROXIMATIONS  BOX- PIERCE  TEST 

1.0  r 


ID 

o 

II 


.5 


o     -4 

Q. 


t        ' I 1 1 1 1 1 r---r-i 


.9   -.8    -.7   -.6   -.5.  -.4    -.3  -.2    - 
LAG    PARAMETER  (c/)) 


0 


FIGURE  4.9a 
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POWER  APPROXIMATIONS  BOX-PIERCE  TEST 
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FIGURE  A. 9b 
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POWER  APPROXIMATIONS  BOX-PIERCE  TEST 
J  =  2,  K=4 
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FIGURE  4.10a 
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POWER  APPROXIMATIONS  BOX- PIERCE  TEST 
J=2,  K  =  4 
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FIGURE  4.10b 
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POWER  APPROXIMATIONS  MAX-X    TEST 
J  =  2,  K  =  4 
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FIGURE   4.11a 
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POWER  APPROXIMATIONS  MAX-X    TEST 
J=2,  K=4 
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FIGURE    4.11b 
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to  be  the  most  accurate  when  the  lag  parameter  is  small.   Overall,  It 
appears  that  the  Rao  square  root  transformation  (BP3)  gives  the  more 
accurate  results  when  n=50.   Notice,  however,  that  v;hen  -.1  -  0  -  .1, 
BP3  gives  an  approximation  which  is  very  nearly  0.   The  attained 
significance  level  of  Rao's  procedure,  then,  is  much  smaller  than  .05. 
From  our  simulation  study  in  Section  4.1.1,  we  discovered  that  the 
actual  level  of  the  test  (simulated)  for  n=50  is  less  than  the  asymptotic 
level  (.05).   The  Rao  square  root  transformation  appears  to  work  v/ell  at 
n=^50  because  it  also  underestimates  the  asymptotic  level,  and  hence, 
expected  power  of  the  Box-Pierce  test  using  the  asymptotic  distribution. 
Figure  4.10  shows  that  when  n  is  increased  to  200,  BP3  does  not  perform 
well.   For  n  this  large,  the  asymptotic  power  of  the  Box-Pierce  test 
is  nearly  attained,  hence  the  simulated  power  better  estimates  the  asymp- 
totic power,  and  the  bias  in  the  BP3  approximation  is  more  readily 
observed.   For  n=200,  Imhoff's  numerical  integration  procedure  (BPl) 
appears  to  give  an  excellent  approximation  to  the  power.   This  result 
should  not  be  surprising,  for  one  must  recall  that  Imhoff's  procedure 
is  only  an  "approximation"  in  the  sense  that  the  numerical  integration 
technique  estimates  the  true  integral  given  in  the  power  expression, 
(Section  3.3.3.2).    Imhoff  derives  the  result  by  inverting  the  charac- 
teristic function  of  the  Box-Pierce  test  statistic  under  the  asymptotic 
distribution.   The  procedure  wou.1  d  be  exact  asymptotically  if  the  integral 
could  be  evaluated  analytically.   Consequently,  v.'hen  n  is  large  enough 
for  the  simulated  power  to  closely  approximate  the  asymptotic  power  of 
the  tost,  as  is  the  case  when  n=200,  a  comparison  of  BPl  to  BP4  gives 
results  which  favor  Imhoff's  technique.   Thus,  it  is  very  likely  that  at 
n=50,  the  numerical  integration  procedure  gives  the  best  approximation  to 
the  asymptotic  power  of  the  Box-Pierce  test. 
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From  these  results,  we  write  the  Box-Pierce  approximations  in  the 
following  increasing  order  of  accuracy:   (1)  Imhoff's  extension  to  the 
Pearson  3-moment  approximation;  (2)  Rao  asymptotic  normal  square  root 
transformation,  and  (3)  Imhoff  numerical  integration.   For  those  re- 
searchers without  a  computer  routine,  we  note  that  the  approximations  are 
also  listed  in  increasing  order  of  difficulty  of  computation. 

Refer  now  to  Figure  4.11  in  order  to  gauge  the  accuracy  of  the 
Taylor-series  approximation  (Ml)  to  the  max-x^  power.   The  results  indicate 
that  the  approximation  overestimates  the  simulated  power  of  the  test, 
although  at  n=200,  the  bias  is  small.   Again,  we  can  attribute  the 
apparently  less  accurate  results  for  n=50  to  the  fact  that  the  simulated 
power,  using  the  critical  region  given  by  the  asymptotic  approximation  to 
the  tail  area  of  the  m.ax-x^  distribution,  underestimates  the  asymptotic 
power  of  the  test.   The  magnitude  of  0  (in  absolute  value)  does  not  appear 
to  affect  the  overall  accuracy  of  the  approximation.   We  warn  that  the 
researcher  without  access  to  computer  facilities  will  encounter  many 
tedious  and  difficult  calculations  when  using  this  approximation  (Section 
4.2.5).   However,  the  Taylor-series  expansions  are  easily  programmed. 
We  present  a  summary  of  the  power  approximation  results: 
(i)   The  accuracy  of  the  power  approximations  is  not  affected  by 
the  change  in  the  lag  (J)  of  the  error  model. 
(ii)   Imhoff's  extension  to  Pearson's  3-moment  approximation 

performs  poorly  as  an  estimate  of  the  true  Box-Pierce  power 
when  the  lag  parameter  is  moderate,  i.e.,  3  -  | P |  -  .7. 
(iii)   Rao's  asymptotic  normal  square  root  transformation  tends  to 
underestimate  the  asymptotic  Box-Pierce  power,  especially 
when  0  is  small. 
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(iv)   Imhoff s  numerical  integration  technique  is  the  most  accurate 
among  the  Box-Pierce  power  approximations  for  large  n. 
(v)   The  Taylor-series  approximation  tends  to  overestimate  the 
asj'mptotic  max-x^  power,  although  this  bias  decreases  as  n 
is  increased. 
4.2.5  A  Note  on  the  Taylor-Series  Approximation 

VJe  have  stated  that  the  researcher  who  attempts  to  calculate  the 
Taylor-series  approximation  to  the  raax-x^  power  without  the  aid  of  a 
computer  will  face  a  difficult  task,  for  the  computations  are  quite 
tedious.   As  part  of  an  investigation  into  simplifying  the  approximation, 
we  computed  each  term  of  the  series  expansion  separately,  in  order  to 
gauge  its  contribution  to  the  overall  estimated  power.   Recall  from 
Section  3.3.3.2.2.  the  expression  for  the  asymptotic  power  of  the  max-x^ 
test  for  K=4 : 

rh  r^2  r^3  r\  (A.2.3) 

pr^On)  ^  ^W}=  !_/    /    /    /    f(y:  0,R)  dy^dy2dy3dy^ 

y    a^J    a^J    a„J    a 
1    2    3    y 

where  {a  }  and  {b.}  are  constants  which  depend  upon  C    ,  p  and  V,  f  is 
11  a    ~ 

the  asymptotic  joint  density  of  the  first  four  sample  autocorrelations, 
and  R  is  the  correlation  matrix  corresponding  to  the  covariance  matrix  V. 
We  approximated  the  integral  in  equation  (4.2.3)  by  a  Taylor-series 
expansion.   Notationally ,  let  us  write  the  max-x^  power  (M,)  as  follows: 

M,  =  1  -  {T  +  T,  +  T„  +  .  .  .}  =  1  -  M 
1         o    1    2  o 

where  T  ,  T  ,  T  ,  .  .  .  are  the  power  contributions  for  each  term  in  the 
o   1   2 


series  expansion  and 


o    1=0  1 
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Computations  for  all  three  cases  discussed  in  this  section,  i.e., 
(J=2,  K=4),  (J=3,  K=4)  and  (J=4,  K=4)  for  samples  of  size  50  and  200 
are  listed  in  Tables  A-35  -  A-40  of  the  Appendix.   Here,  we  give  only 
the  percent  contribution  of  T  to  the  sura  of  all  terms  M^  in  the  Table 

4.11. 

Except  for  the  case  J=2,  K=4,  n=50,  l0|  =.7,  the  ratio  of  the  initial 
term  T   in  the  Taylor-series  approximation  to  the  sum  of  the  terms  M^  is 
at  worst  .7  and  in  most  cases,  very  nearly  1.   Thus,  the  user  of  the 
Taylor-series  expansion  technique  can  simplify  calculations  considerably 
by  only  considering  the  first  term  of  the  expansion,  and  still  obtain  a 
rather  accurate  estimate  of  the  max-x^  power.   To  obtain  T^,  we  let  t=0 
in  equation  (3.2.23)  which  gives  the  first  terra  of  the  series  expansion 
of  the  asymptotic  joint  density  of  the  first  K  sample  autocorrelations. 
This  amounts  to  substituting  the  identity  matrix  I  for  R  in  (4.2.3). 
Hence,  our  simplified  approximation  of  the  power  is  given  as: 


Now  the  right-hand  side  of  (4.2.4)  is  easily  integrated.   Using  Theorem 

10,  we  obtain 

4 
p^^(m)  >  c^™^}^l  -  .n,  [<i(h.)    -   0(a.)]  (4.2.5) 

where  ^(x)  =  /    _1_  -z'^h   dz  and  {b^},  {a^}  are  given  by  equation 
(3.3.29).   The  researcher  only  needs  to  have  access  to  tables  of  the 
cumulative  normal  distribution  function,  which  are  readily  available. 
The  point  to  be  made  here  is  that  even  though  the  covariance  matrix  V 
of  the  first  K  sample  autocorrelations,  r^,  r^,  .  •  •,  r^,,  is  non-diagonal, 
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TABLE  4.11 


TAYLOR-SERIES  APPROXIMATION 

CONTRIBUTION  OF  T  TO  THE  SUM  M  - 
o  o 


(J=2, 

K=4) 

(J=3, 

K=4) 

(J=4, 

K=4) 

0_ 

.9 
.7 

n=50 

n=200 

n=50 

n=200 

n=50 

n=200 

.278 

— 

.747 

— 

.886 

— 

.5 

.741 

~ 

.949 

~ 

.974 

~ 

.3 

.971 

.878 

.993 

.993 

.997 

.997 

.1 

.999 

.999 

.999 

.999 

.999 

.999 

.1 

.999 

.998 

.999 

.999 

.999 

.999 

.3 

.962 

.870 

.993 

.993 

.997 

.997 

.5 

.700 

~ 

.949 

— 

.974 

— 

.7 

.232 

~ 

.747 

~ 

.881 

— 

.9 











— 

*The  figures  given  represent  percentages  of  the  sum  M  .Where  no  figures 
are  given,  M  =  T  =0. 
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i.e.,  covariability  of  the  r.'s  exist,  these  covariances  in  many  cases, 
do  not  contribute  significantly  to  the  approximate  power  of  the  max- X 
test  when  the  sample  size  n  is  large.   However,  we  note  that  the  simpli- 
fied approximation  given  in  (4.2.5)  will  tend  to  overestimate  the  true 
power  of  the  max-x^  test  to  a  slightly  greater  degree  than  the  full 
Taylor-series  approximation. 

4 . 3   Summary 

We  have  presented  an  extensive  simulation  study  of  the  powers  of 
three  tests  designed  to  detect  serial  correlation  of  the  errors  in 
regression  in  the  presence  of  low  order  autoregressive  models:   the 
Box-Pierce  test,  the  max-x^  test  and  the  Durbin-Watson  d  test.   Also, 
the  accuracy  of  the  power  approximations  of  the  Box-Pierce  and  max-x 
tests  was  investigated. 

As  expected,  the  Durbin-V7atson  d  test  performs  extremely  well  when 
the  regression  residuals  follov^7  a  first  order  (lag  1)  autoregressive 
process.   Since  the  AR(1)  process  is  a  very  important  case  in  practice, 
we  conclude  that  it  is  always  worthwhile  to  apply  the  d  test.   However, 
our  simulation  results  show  that  this  procedure  attains  a  very  low 
power  when  the  autoregressive  model  is  not  first  order  of  lag  1.   The 
d  test,  then,  should  be  supplemented  by  another  test  which  has  high 
power  in  this  non-first  order  case.   Our  simulation  results  indicate 
that,  of  the  two  candidates  for  the  supplementary  test,  i.e.,  the  Box- 
Pierce  and  mar-i-x   tests,  the  max-x   test  consistently  outperformed  the 
Box-Pierce  procedure.   The  differences  in  the  powers  of  the  two  tests 
V7as  most  noticeable  when  the  lag  parameter  of  the  alternative  error 
model  was  negative  and  when  the  maximum  lag  of  the  model  (J)  was  small 
compared  to  the  number  of  sample  autocorrelations  included  in  the  test 
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statistics  (K) .   We  recommend,  then,  the  max-x^  test  as  the  most 
logical  alternative  to  the  Durbin-Watson  d  test,  assuming  a  low-order 
(small  number  of  non-zero  lags)  autoregressive  model. 

Our  investigation  of  the  three  approximations  to  the  Box-Pierce 
power — Imhoff's  numerical  integration,  Rao's  asymptotic  normal  square 
root  transformation  and  Imhoff's  extension  to  Pearson's  3-moment  approx- 
imation— indicates  that,  although  all  three  approximations  work  fairly 
well  for  certain  values  of  the  lag  parameter,  the  numerical  integration 
technique  is  the  overall  most  accurate  procedure.   VHien  the  sample  size 
is  large  (n=200),  the  numerical  integration  technique  gives  an  excellent 
approximation  to  the  asymptotic  power  of  the  Box-Pierce  test. 

The  Taylor-series  approximation  to  the  power  of  the  max-x   test 
performs  reasonably  well  for  large  n,  but  tends  to  consistently  over- 
estimate the  asymptotic  power  of  the  test.   The  results  of  the  study 
indicate  that  the  contribution  of  first  term  of  the  series  expansion 
to  the  overall  approximate  power  expression  is  nearly  100%  of  the  total 
sum.  of  all  the  terms  in  the  series  for  most  cases.   Thus,  the  researcher 
may  simplify  calculations  considerably  by  considering  only  the  first 
term  in  the  Taylor-series  as  an  estimate  of  the  power  of  the  max-x 
test  for  large  n. 


CFiAPTER  V 

OTHER  ASYJiPTOTIC  PROPERTIES  OF  THE  BOX-PIERCE 
AND  MAX-X^  TESTS 


We  have  seen  (Section  3.3)  that  the  exact  distributions  of  the 
Box-Pierce  and  max-x   test  statistics  become  intractible  even  in  those 
cases  when  the  alternative  error  model  is  close  to  white  noise  (i.e., 
a  model  with  a  single  nonzero  lag  parameter) .   In  order  to  compare  the 
two  competing  tests,  we  turned  to  their  asymptotic  properties.   In  Chapter 
4  the  powers  of  the  tests  \vfere  simulated  using  critical  regions  determined 
from  the  respective  asymptotic  null  distributions  of  the  test  statistics, 
for  sample  sizes  of  50  and  200.   Our  goal  in  Chapter  5  is  to  investigate 
th.e  rate  at  which  the  pov/ers  of  the  tests  tend  to  one  as  the  sample  size 
increases.   Particularly,  we  wish  to  determine  the  test  with  the  faster 
rate  of  convergence  under  various  alternatives  specified  by  J  (the  model 
lag)  and  K  (the  number  of  sample  autocorrelations  included  in  the  test 
statistics) . 

5.1  Asymptotic  Powers  for  Large  n 

In  this  section,  the  as^nnptotic  powers  of  the  Box-Pierce  and  max-x ' 
tests  are  computed  for  sample  sizes  ranging  from  50  to  5000.   The  best 
and  most  reliable  method  of  generating  the  asyn:;:otlc  powers  of  the  tests 
is  to  employ  the  simulation  technique  outlined  in  Section  4.1.   Using 
11=1000  iterations,  a  most  conservative  bound  on  th.e  error  of  estimation 
of  the  power  is 
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5)(.5) 

However,  this  technique,  even  for  samples  as  small  as  n=50 ,  requires  an 
extraordinary  amount  of  computer  time.   Since  the  asymptotic  distributions 
of  the  test  statistics  provide  good  approximations  to  the  true  distributions 
for  very  large  n,  we  resort  to  those  approximate  methods  of  computing  the 
asymptotic  power  discussed  in  Sections  3.3  and  4.2.   Recall  that  the  method 
which  best  approximates  the  asymptotic  power  of  the  Box-Pierce  test  is 
Imhoff's  numerical  integration  technique.   The  method  is  only  an  approxima- 
tion in  the  sense  that  the  integral  which  appears  in  the  power  expression 
can  only  be  evaluated  numerically.   Based  on  the  power  results  for  n=200, 
Imhoff's  method  should  provide  an  excellent  approximation  to  the  asymptotic 
Box-Pierce  power  for  the  large  values  of  n  which  we  consider.   Our  only 
approximation  to  the  asymptotic  max-x^  power — the  Taylor-series  expansion 
technique — improved  greatly  when  the  sample  size  was  increased  from  50  to 
200.   One  would  expect  the  method  to  improve  even  more  for  n  larger  than 
200.   However,  the  expansions  become  unwieldy  for  K  as  small  as  4  (Sections 
3.3.3.2,  4.2.2  and  4.2.3).   For  purposes  of  this  section,  we  only  consider 
the  initial  term  in  the  Taylor-series  expansion  of  the  max-x^  asymptotic 
power.   From  our  investigation  in  Section  4.2.5,  the  relative  contribution 
of  this  first  term  to  the  overall  power  is,  in  many  cases,  nearly  100%, 
thus  providing  only  a  slight   overestimate  of  the  asymptotic  power  of  the 
max-x   test. 

The  alternative  error  model  under  which  the  pov;ers  of  the  tests  are 
computed  is  the  first  order  AR  lag  J  model 

Z^  =  0Z^_,  +  .^,  (5.1.1) 
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v;liere  {e  }  is  a  white  noise  process.   The  various  values  of  J,  K,  0  and 

n  considered  in  this  study  are  given  in  the  following  table. 

As  stated  in  the  introduction  to  this  chapter,  we  are  particularly 

interested  in  determining  which  asymptotic  power  converges  to  one  at 

the  fastest  rate  for  a  given  value  of  K.   Our  initial  plan  was  to  consider 

K=4,  12  and  24,  consistent  with  the  values  of  K  employed  in  the  simulation 

study.   However  for  K=12  and  K=24  we  experienced  great  difficulties  in 

computing  the  value  of  the  integral  in  Imhoff's  Box-Pierce  power  expression. 

The  problem  is  that  the  variance-covariance  matrix  (V)  of  the  asymptotic 

distribution  of  the  first  12  (or  24)  sample  autocorrelations  is  very  nearly 

singular  (e.g.,  | v]  =  7x10"^  for  J=2,  K=24) .   These  near  singularities 

prevent  the  numerical  integration  technique  that  we  used  (available  in 

the  IMSL  FORTRiVN  package)  from  computing  reliable  values  in  some  cases, 

and  in  most  cases,  any  values  at  all.   Unable  to  obtain  asymptotic  powers 

of  the  Box-Pierce  test  for  K=12  and  K=24,  we  added  the  case  K=8  in  order 

to  compare  rates  of  convergence  across  at  least  two  different  values  of 

K. 

We  present  a  portion  of  the  results  in  the  form  of  figures  ,  as  in 

Chapter  4.   Once  again,  the  complete  set  of  numerical  results  is  given 
in  the  Appendix  (Tables  A-41  -  A-44) . 

Figures  5.1  -  5.4  represent  power  curves  for  the  tests  as  n  is  in- 
creased to  infinity  and  the  values  of  J,  K  and  0  are  kept  fixed.   It  is 
interesting  to  note  that  for  very  small  values  of  the  lajj-  parameter  (0  = 
-.1  or  .1),  a  sample  size  of  at  least  2000  is  needed  before  the  tests 


Note  that  the  horizontal  axis  in  Figures  5.1  -  5.4  is  not  drawn  to 
scale. 
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Parameters; 


TABLE  5.1 

ASYMPTOTIC  POWER  COtlPARISONS 
BOX-PIERCE  AND  I-IAX-x^  TESTS 
ERROR  MODEL:   ^  =0Z   +e 


(J,K) 

0 

n 

(1,4) 

-.5 

50 

(2,4) 

-.3 

100 

(3,4) 

-.1 

200 

(4,4) 

.1 

500 

(1,8) 

.3 

1000 

(2,8) 

.5 

2000 

(3,8) 

5000 

,05 
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ASYMPTOTIC  POWERS   J=1,K=4 
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_t(m) 

c^  =  .3 
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_   j(M) 

■-/ — ^ — ^ 
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SAMPLE    SlZE(n) 


FIGURE   5.1 
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ASYMPTOTIC  POWERS  J=2,K=4 


1.0  r 


.7 


in 
O 
II 


en 

LU 


.5  - 


6    .4 

CL 


.2 


■v^ 


V ^ — ^^ — ^ — ^-^ — ^ — ^ ^ 
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FIGURE   5.2 
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ASYMPTOTIC  POWERS  J=I,K=8 


1.0  r 


.9 


.8 


O 
II 


.6 


O      .4 
CL 


/   r1 

//            /  .•• 

V     // 

— >■ —  —  ■ 

// 

1 

// 

// 

1 

—  T^^'"^ 

4>-- 

,1 

_-p(M) 

...T^BP^ 

4>-- 

.3 

_^(M) 

,„    -^ 

_  J^QP) 

4>- 

.5 

__  j(M) 

_^ 1 / 1 ^ i y^ 1 ^A. 
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SAMPLE    SlZE(n) 


FIGURE   5.3 


140 


ASYMPTOTIC  POWERS  J=2,K=8 
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FIGURE  5.4 
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tittain  an  asymptotic  power  of  1,  while  for  moderate  values  of  0  (-.5  or 
.5),  powers  of  1  V70uld  be  attained  for  n=100  if  the  true  distribution 
of  the  test  statistic  had  converged  to  the  asymptotic  distribution.   A 
comparison  of  the  asymptotic  powers  of  the  tests  reveals  that,  for  each 
combination  of  J,  K  and  0  sho\m  in  the  figures,  the  asymptotic  power  of 
the  max-x^'  test  converges  to  1  at  a  faster  rate  than  the  asymptotic  power 
of  the  Box-Pierce  test,  i.e.,  the  minim.um  value  of  n  needed  for  the  max- 
yj^   test  to  attain  a  power  of  1  is  smaller  than  the  corresponding  value 
for  the  Box-Pierce  test.   This  result  also  holds  true  for  those  cases  not 
presented  as  figures  but  given  in  the  Appendix.   In  particular,  note  the 
results  for  |0j  =  .1.   At  this  low  value  of  the  lag  parameter,  the  Box- 
Pierce  test  dominates  the  max-x^  test  when  n  is  200  or  smaller.   This 
result  agrees  with  our  simulations  in  Chapter  4.   However,  for  n  between 
200  and  500,  the  power  curves  cross  and  the  max-x^  test  begins  to  dominate. 
From  earlier  results,  the  researcher  who  attempts  to  detect  serial  cor- 
relation of  the  errors  in  the  presence  of  error  models  of  the  form  of 

2 
(5.1.1)  with  low  lag  coefficients  using  either  the  Box-Pierce  or  max-X 

test  and  sample  sizes  of  50  or  200,  will  fail  to  reject  the  null  hypoth- 
esis of  wliite  noise  at  a  very  high  rate.   Neither  of  the  two  tests  pro- 
vide the  researcher  with  a  reliable  procedure.   But  when  n  is  increased 
to  1000,  both  tests  attain  reasonable  power,  and  the  max-x^  test  is  the 
more  powerful  test. 

From  simulation  at  n=50  and  n=200,  we  noted  that  the  m.ax-x^  procedure 
appears  to  be  less  sensitive  to  an  increase  in  K,  in  terms  of  power  loss. 
This  result  also  holds  true  for  very  large  values  of  n.   Compare  Figures 
5.2  and  5.4,  the  case  (J=2,  K=4)  versus  the  case  (J=2,  K=8) .   Especially 
at  the  low  lag  parameter  value  of  .1,  the  difference  between  the  max-x" 
pov/er  and  Box-Pierce  power  noticeably  increases  (for  n  greater  than  500) 
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as  K  is  increased  from  4  to  8 .   Simulation  at  n=50  and  n=200  indicates 
that  this  difference  is  even  greater  for  K=12  and  K=24.   Thus,  the  max- 
X^  test  attains  a  power  of  1  with  a  significantly  smaller  sample  size 
than  is  needed  for  the  Box-Pierce  test. 

From  the  results  presented  in  this  section,  we  conclude  that  for 
alternative  error  models  given  by  (5.1.1)  with  J  (the  model  lag),  0 
(the  lag  parameter)  and  K  (the  number  of  autocorrelations  included  in 
the  test  statistic)  fixed,  the  max-x^  asymptotic  power  converges  to  1 
at  a  faster  rate  than  the  Box-Pierce  asymptotic  power  as  n  (the  sample 
size)  tends  to  infinity.   In  Section  5.2,  we  investigate  a  type  of 
asymptotic  relative  efficiency,  due  to  Hodges  and  Lehmann,  which  relates 
closely  to  the  problem  of  power  convergence. 

5.2  Hodges-Lehmann  Asymptotic  Relative  Efficiency 

J.  L.  Hodges,  Jr.  and  E.  L.  Lehmann  [21]  developed  an  alternative 
notion  of  asymptotic  efficiency,  designed  to  measure  the  "speed  with 
which  power  at  a  fixed  alternative  tends  to  1."   The  relevance  of  this 
type  of  efficiency  to  the  results  of  the  preceding  section  is  clear. 
Bascially,  the  objective  of  Hodges  and  Lehmann  asymptotic  relative 
efficiency  (HLARE)  is  to  compare  the  rates  at  which  the  power  functions 
of  the  tests  converge  to  1,  for  a  fixed  alternative  (9)  and  fixed 
significance  level  (a).   The  test  with  the  faster  rate  of  convergence 
is,  of  course,  deemed  superior.   A  more  rigorous  definition  follows. 

Definition  3  (Hodges-Lehmann):   Define  3  (N,a,0)  to  be  the  pcv;er 
of  test  A  at  significance  level  a  under  the  alternative  0,  using  N 
observations.   Define  3."(N",a,6)  for  test  A"  similarly.   Then  the 
relative  efficiency  of  A"  to  A  is  N/N",  where  N"  is  the  sample  size 
needed  for  test  A*  to  have  power  3.(N,a,0),  i.e.,  B  "(N'So,9)  = 
6^(N,a,e).       D 
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Hodges  and  Lehmann  (H-L)  note  that  there  usually  v/ill  not  exist 

an  integer  N-  such  that  B  '-(N'Sc^G)  =  B  (N,a,  9),  but  rather  an  integer 

N  such  that  B.*(N  ,a,e)  <  B,  (N,a,e)  <3  ''-(N  +l,a,G)  .   Given  the  existence 
O  A    O         A  A    O 

of  N  ,  the  H-L  technique  for  choosing  N*  is  stated  as  follows: 
o 

Definition  4:   Define  N"  of  Definition  3  to  be  N  +p,  where 

g.''(N  ,a,G)  <B.(N,a,0)  <  B."(N  +l,a,9)  and  where  the  test  A-  has  power 
A   o        A  A   o 

B  (N,a,G)  if  its  number  of  observations  is  randomly  chosen  as  (N  +1) 
A  o 

with  probability  p  and  N  with  probability  1-p.      □ 

The  value  of  N"  defined  above,  then,  is  simply  the  expected  number 

of  observations  required  for  test  A*  to  match  the  power  of  test  A,  when 

randomizing  between  consecutive  integers.   Given  this  value  of  N*,  the 

HLAEIE  is  defined  as  follows. 

Definition  5:   The  Hodges-Lehmann  asymptotic  relative  efficiency 

(HLARE)  of  test  A-  to  A  is  defined  to  be 

lim  _N 
N->co  N-A- 

where  N  and  N"  are  defined  as  in  Definitions  3  and  4.      Q 

H-L  also  give  a  technique  useful  for  calculating  the  HLARE.   The  result 

is  stated  here  as  a  lemma. 

Lemma  15  (Hodges-Lehmann):   Define  B (9)  =  B.(N,a,9)  to  be  the  power 

of  test  A  at  significance  level  a  under  the  alternative  9,  using  N 

observatons,  and  B*(9)  =  B.*(N,a,9)  similarly.   Suppose  also  that 

^Vl-B(G)   >■  b(9)    as  N  ->  «> 

and 


Vl-B"(9)  ?>-  b'Ke)   as  N  -> 
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If  N*  is  defined  as  in  Definition  4,  then 

N"  ^  In   b"(Q) 

N ^  £n  b(e)     ^«  -  -  -  • 

Proof;   See  Hodgcs-Lehmann  [21],  ppg.  329-333.    D 

As  a  result  of  Lemma  15,  the  HLARE  of  A  to  A*  may  be  obtained  by  computing 

the  ratio 

^  Zn   b*(Q) 
^A,A"    £n  b(e) 

Ideally,  we  would  like  to  compute  the  HLARE  of  T^   ^  to  T   \  where  T^ 
and  T    are  the  Box-Pierce  and  max-x^  tests,  respectively.   However,  two 
main  problems  are  encountered.   First,  since  the  exact  non-null  distribu- 
tions of  the  test  statistics  are  unkno\vm,  the  exact  power  function  of  each 
test  is  intractible  and  can  only  be  approximated  using  the  asymptotic 
distributions.   Hodges-Lehmann  make  no  mention  of  the  possible  drawbacks 
of  using  asymptotic  power  functions  in  place  of  exact  power  functions  in 

HLARE  theory.   Secondly,  given  that  we  assume  that  the  asymptotic  power 

N  / 

expressions  closely  approximate  the  exact  powers,  the  limit  of   /  1-B(0) 

as  N  ->  "^  is  not  easily  computed.   In  the  case  of  the  max-x^  statistic, 
the  power  function  is  approximated  by  a  Taylor-series  expansion  of  the 
asymptotic  density  function  of  the  first  K  sample  autocorrelations.   The 
terms  of  the  infinite  expansion  may  or  may  not  be  functions  of  N,  de- 
pending upon  the  structure  of  the  alternative  error  model.   It  is  difficult  to 
determine  what  effect  those  terms  omitted  from  the  expansion  will  have 
on  HLARE.   For  the  Box-Pierce  test,  the  problem  is  even  greater.   Imhoff's 
approximation  to  the  Box-Pierce  asymptotic  power  involves  an  integral 
which  cannot  be  written  in  closed  form.   Our  only  recourse  is  to  use 
either  of  the  otlier  two  Box-Pierce  power  approximations  described  in 
Section  3.3.    Of  these,  though,  Imhoff's  extension  to  Pearson's 
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3-moineat  approximation  also  becomes  unmanageable,  since  the  method 
involves  evaluating  a  tail  probability  of  a  non-central  x   random 
variable.   Rao's  asymptotic  square  root  transformation,  however,  per- 
mits a  workable  approximate  power  function.   Although  the  application 
of  the  HIARE  procedure  to  the  test  statistics  using  approximate  asymp- 
totic powers  cannot  guarantee  reliable  results,  we  feel  that  an  attempt 
at  obtaining  the  "approximate"  HLARE,  will  at  the  very  least,  provide 
valuable  insight  into  the  power  convergence  question. 

We  consider  testing  the  hypotheses  H  :  0  =  0  versus  H  :  0  7^  0, 

O  a 

under  the  alternative  error  model 

Z^  =  0Z  ,  +  c^  ,  (5.2.1) 

t      t-4     t 

V7hcre  the  {  t:  }  is  a  white  noise  process.   The  number  of  autocorrelations 

that  we  choose  to  include  in  our  test  statistics  is  four,  hence  the  case 

J=4,  K=4.   We  select  this  rather  simple  case  in  order  to  eliminate  the 

problem  of  omitting  terms  of  order  n  in  the  Taylor-series  expansion  of 

the  max-x^  power.   Equation  (4.2.2)  from  the  Theorem  12  shows  that  n 

appears  in  only  the  first  term  of  the  series  expansion.   In  general, this 

will  be  true  as  long  as  J=K.   Thus,  although  the  HLARE  of  T^     to  T^"^^ 

is  stated  and  proved  for  J=K=4,  the  result  applies  to  the  more  general 

case  J--=^K.   The  proof,  however,  requires  a  lemma  which  we  state  first. 

Lemma  16:   For  large  N,  the  expression  'i>(K-v¥6)  is  equivalent 

(in  the  sense  of  ratio)  to 

(---)  P-^  '^^^P  f  -  (?)  ( >^5-^) '  >   .  (5.2.2) 

\/n5/  \v'^/ 

x/here 

?>(x)  =       -i-  e  "-    dz   , 

K  and  u  are  fi.xed. 
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Proof:   From  [  3]  pg.  932,  an  approximation  for  l-4>(x)  for  x  >  0 

X        ^  x2+2    (x^+2) (x^+4)     •  ''' 

where  a  ,  a  ,  a  ,  .  .  .  are  constants  which  do  not  depend  on  J?.   Since 
l-$(x)  =  $(-x),  we  have  for  x<  0 

-^exp{-ix2}  (5.2.3) 

/o~      2        a         a 

^^^> ^ (--^?T2+  (x^+2)(x^+4)  +  •  •  •)   ' 

where  ~  means  "is  approximate  equal  to."   Substituting  K-/N6  for  x  in 
equation  (5.2.3),  we  obtain 

-^   exp{-  |-(/n5-K)^ 

0(K->¥5)  ~      ^"^  [1 -i +...]. 

v¥6-K  (K-v^6)2+2 

For  large  N  then,  we  have 

-^  exp{-  |(/n6-K)^ 
$(K-/N(S)  ~    , 

which  is  the  desired  result.        □ 

Theorem  13:   The  HLARE  of  T^^^"^  to  T^™^  for  the  case  (J=4,  K=4)  is 


Proof:   This  proof  utilizes  the  result  given  by  Lemma  16.   First  consider 
the  max-x^  test,  T    .   From  Equation  (4.2.2),  the  power  (asj^mptotic)  of 
T    can  be  expressed  as 

B(N,a,0)  =  1-[$(K-v/N6)-$(-K-v^6)]  [A]  (5.2.4) 

v'here  

/i-0^  /ry 
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and  A  is  a  constant  free  of  N.   Then, 


^/l-3(N,a,0)   =  [$(K-^'N6)  -  4'(-K-/n5)  ]^  {A}^  (5.2.5) 

Utilizing   the  result   from  Lemma   17,   we  may  vnrite   the  right-hand   side  of 

equation    (5.2.5)    as 

i  1  i         1 

/n6        /27 

1  1  1  _      i         i 

=    ( — —)    (N)    2N[e  ]    [e  ]    [e  -e  ]      {A} 

6/2ii 

i     1  i  1 

=    ( )    (e2N        )[e   ^      ]  [e  ]    exp{-2,n  (  -e  )}{A} 

6/2"Tr  ^     ■ 

i        T  i  i 

=    (— )    (e    m        )[e  ][e  ]      exp{--J,n(e  )  (1+0(1))  }{A} 

6/2"tt  ^ 

1  1  gj,  1 

=    ( )    (e2N     ^[e  ]  [e  ]    expl   /-  (1+0(1)) }    {A} 

6/2^T 

In   this    form,    it    is    easy   to   see   that 

^"'»'I^3(N,a,0)  ^     exp{-  |62}      as  N  -^    " 


where 

6 

/I 

0 

-0^ 

Tbaj 

for 

,p(m)^ 

b(0)    =  exp{-(|)Yj§7y}        . 

Now   consider    the  power   expression   for    the  Box-Pierce   test,    T 
Recall   fro-a  equ.rition   3.3.20,    the   Box-Pierce   pov/er   expression   usin; 


(BP) 
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Rao's  square  root  transformation: 


3"(N,a,0)  =  1  -  ^(K'^--v4r6-'0  +  ^i-K*-/N&*) 


(5.2.6) 


where 


K*  = 


(p'p)''(p'Vp)- 


(p'Vp)- 


and  P  and  V  are  the  mean  vector  and  covariance  matrix,  respectively,  of 
the  asymptotic  distribution  of  the  first  K  sample  autocorrelations.  The 
result  that 


^'/l^B-"-(N,a,0) 


->  exp{-  j(5*)}      as  N  -> 


follows  directly  from  the  max-X   case.   We  are  left,  then,  to  determine 
(6*)   for  the  case  (J=4,  K=4).   From  Section  4.2.3,  we  have,  for  this 


p  =  (0,  0,  0,  0)'  , 


and 


V  = 


1+02 
1-0^ 

0 

20 
1-0^ 

0 

(1+0)2 
1-0 

0 

20 
1-0^ 

0 

1+02 
1-02 

0 

0 

0 

Thus,   p'p  =  02 and  p'Vp  =  02(1-02).   Hence, 


1-i 


(£'6)2 


^^^>"%> 


02(1-02) 


CFiP')  1     fl2 

and  for  T^      i    h-H0)    =   exp{  -(•-)  "TJ^MTy}  •   Since  b(0)  and  h-'=(0)    are  equiva- 
lent, we  have,  in  the  case  (J=4,  K=4) ,  HLARE  of  T^^^''  to  T^"^  equal  to  1.   □ 
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At  first  glance,  the  result  of  Theorem  13  seems  to  contradict  the 
asyinptotic  power  comparisons  for  large  n  of  Section  5.1,  where  we  con- 
cluded that,  for  fixed  J,  K,  and  0,  the  minimum  sample  size  needed  (n) 
for  the  max-x^  power  to  equal  1  was  less  than  the  corresponding  sample 
size  (n")  for  the  Box-Pierce  test.  However,  note  that  the  slopes  of 
the  power  curves  in  Figure  5.1  -  5.4  are  nearly  indentical,  and  although 
the  max-x^  does  attain  a  power  of  1  first,  the  difference    n"-n  does 

not  appear  to  be  very  large.   We  would  expect,  then, ^-     1  as  n 

infinitely  increases.   Since  the  HLARE  is  essentially  the  limiting  ratio 
of  the  sample  sizes  needed  for  the  tests  to  attain  equal  powers  for  fixed 
0,  a,  J,  K,  the  result  is  not  surprising.   However,  Hodges  and  Lehmann  [22] 
state  that  if  tv;o  tests  have  HLAR.E  =  1,  this  does  not  necessarily  imply 
that  the  tests  are  asymptotically  equivalent.   In  fact,  they  point  out 

that  when  HLARE  =  lira  —  =  1,  it  may  be  more  meaningful  to  consider  the 
n^=°  n 

more  natural  quantity,  HEAD  =  lim(n"-n),  called  the  asymptotic  deficiency. 

n~)-» 

If  the  limit  exists,  HEAD  can  be  interpreted  as  a  measure  of  the  additional 

number  of  observations  needed  by  T     to  attain  the  same  power  as  T 

for  fixed  K,  J,  0  and  ct.   Considering  the  asymptotic  power  results  of 

Section  5.1,  this  concept  of  asymptotic  deficiency  is  worthy  of  further 

investigation. 

The  basic  technique  outlined  by  Hodges-Lehmann  [22]  is  to  equate 

the  powers  of  the  two  competing  tests,  with  respective  sample  sizes  of 

n  and  n--.   Letting  d   =  n-'>-n,  it  may  be  possible  to  show  that  d   con- 
'^  n  n 

verges  as  n  tends  to  infinity.   We  compute  the  HLi\D  of  T     to  T    , 

(BP) 
i;here  wa  take  n*   to  be  the  sample  size  associated  with  T     and  n  to 

(m) 

be  ctie  sample  size  associated  with  T    .   Again,  the  result  is  given 

in  the  following  the  -em  for  J=K=4,  but  also  applies  to  the  more  general 
J=K.  CDse. 
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Theorem  14:   Let  3(N,a,0)  be  the  power  of  the  max-x^  procedure  under 
the  alternacive  error  model  given  by  (5.2.1).   Let  N"  be  the  required 
sample  size  for  the  Box-Pierce  test  to  have  equivalent  power,  and  define 

d^,  =  N*-N.   Then  for  the  case  J=K=4, 

N 

lim  d.,  =  °° 

2 
Proof:   From  Theorem  13,  equation  (5.2.4),  the  power  of  the  max-X   test 

can  be  expressed  as 

e(N,a,0)  =  l-[0(Kj^-v¥5)  -  $(-K^->/N6)][A]  , 


where 


/^Cm) 


K,  = 


■•■     /iW  /i^ 


and  A  a  constant.   Similarly,  from  equation  (5.2.6),  the  Box-Pierce  power 
is  given  as 


B=?c(NA,a,0)  =  1-[$(K2-/P6)  -  ^(-K^-Zn^S)]  , 


wher  e 


and  6  as  above.   In  order  to  find  the  HLAD,  we  need  to  equate  the  tv>70 
powers.   First,  consider  the  following.   Assume  5>  0  (I.e.,  0  positive) 
Then  for  large  N 

$(K-^/^6)  -  0(-K-»¥6)^^'5(K-y^^5), 

(f(_K-v^(S) 
in  tlie  sense  of   ratio,    since   lim  -tt;. — r^^v"  ~  0    (L^llospital) . 

^(K-i'i^lo) 

Conversely,  for  6>0  (i.e.,  0  negative),  $(K-/n5  )-4>(-K-v'^o )  :=5r:  l--o(-K.-t*^N6  ) 
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when  N  is  large.   We  use  these  results  to  simplify  the  power  functions 
given  above. 

First,  consider  the  case  6>  0.   Then  6(N,a,0)  :^  $(K  -v¥6) (A)  and 
S*(N*,a,0);=^  ^(K„-^^6) .   Equating  the  powers  of  the  tests,  we  write 


Applying  Lemma  17,  we  obtain 


(— )(-^)exp{-  4(K,-/n5)2}.A  =  (-^)(-^)exp{-  ^(K,  -/n^6)2} 
v^6   /27         ^  /^7T.       rTT- 


^N"6   /2tt 


<^=>       (-^)exp{-  -kK2-2v¥K  6+N62)}   A=(-^^ — )exp{-  •|(k2-2/n^''K  6+NA62)} 


^' 


/•   1   \    ~2Kt        V NK,  6      —2       ,,,  ,      ju    X    —2x^9      »i\--ix„u 

=>       ( )e        -'-   •  e        1   -e  (A)    =    (— ^^ — )e        ^' c  1   -  e. 

v¥6 


1^,    -iK^      >^"K^6      -2 


4H5' 


<=>      /lV^4-Ki>(A)    =  e-i^'^^^"-N>    .  JK^S/n^-K^Sv^) 


(5.2.7) 


Now  let   d   =N'>-N  and   consider   the   last    terra  on   the  right-hand   side 
of    equation    (5.2.7).      Substituting  d  +N   for   N"   and   expanding,    we  have 


K  6/N+d   -K,6v^  =   6[K„/N+d  -K./n] 
2  N     1  2  N     1 


=   /n6[K„    1+  ^  -  K  J 

2  M  1 


=   /n6[K   {1+^+   0(^)}    -K    ] 
2  2n  N  1 

Substituting  back  into   equation    (5.2.7),    we  obtain 


j^      e        2      1^(A)    =   e 


4  62(dj^)    ^    v^6[K2v'Tf%   -  K   ] 


<^>         (1  +  ^)e^-^i)(A2)    ^   e-^N5^e2'^^    ^S^  "  ^J 
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Taking  logs  of  both  sides,  gives 

2£n(A)  +  )ln(l+^)  +(k2-kJ)  =  -6^  (dj^)+2/N'6[K2*'l+^ -K^] 


i^N, 


<=>   52  (dj^)  =  -2Jin(A)-iln(l-K^)  +  (K2-K^)  + 

2/N6[K„{l+^+  0(-)}    -K,] 

2     9M       M       i 


dN 


-2£n(A)    ^n(l+_^) 


3i,«|;5iu^[K,a.|.o(l),-K,, 


Now,  since  lim  rj—  =  1  (Theorem  13),  then  lim  _i^  =  0.   Thus, 


N^< 


N^co  N 


lim  d.. 


if  K2-K1   ^  0 

6 
if  Ko-Ki 

2   -*-   <  0 

6 


Since  C^^^^  >  C^"^^  for  all  a,  then  K^>K^  and   ^.  -*-   >  0.   Thus, 


lim  dxT  =  ». 


N-^ 


N 


For  6<0,  we  have  <5(k-/n6)-$(-K-/N6)^^^(-K-/N6)  for  large  N.   Hence,  we 
only  need  to  replace  K-^   by  -K,  and  K„  by  -K   in  the  above  proof.   This 

^  if  -JL -   ,  n 


gives 


lim  d 


N 


_.  if  K1-K2 


Ki-Ko 

But  K  >K  and   6<0  implies  that  — >  0,  hence  for  6  positive  or  negative 

2   1  6 


lim  dv  =  lim(N*-N)  = 


N-^c 


N-^c 


□ 


The  result  in  Theorem  14  implies  that  the  Box-Pierce  test    is  asymptotically 
deficient  when  compared  to  the  max-x^  procedure,  i.e.,  asymptotically,  the 
additional  number  of  observations  required  for  the  Box-Pierce  procedure  to 
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to  attain  the  same  power  as  the  max-x^   test  tends  to  infinity.   This 
measure  of  asymptotic  deficiency  strongly  supports  our  asymptotic  power 
results  of  Section  5.1  and  provides  additional  evidence  that  the  max-x^ 
test,  for  large  n,  outperforms  the  Box-Pierce  test. 

Before  discussing  the  next  topic  in  this  chapter,  we  make  two 
comments.   First,  we  remind  the  reader  that  n-  and  n  represent  con- 
servative and  liberal  estimates,  respectively,  of  the  sample  sizes  needed 
for  the  tests  to  attain  identical  powers,  since,  in  fact,  the  Rao  square 
root  transformation  tends  to  underestimate  the  asymptotic  Box-Pierce  power  . 
while  the  first  term  of  the  Taylor-series  expansion  tends  to  overestimate 

the  asymptotic  max-x^   power.   Second,  the  fact  that >  1   v/hile  n*-n*<^ 

n 

implies  that  n*-n=0(n  ),  where  0<C<1.   Knowledge  of  e  will  provide  the 
practical  researcher  with  valuable  information  on  the  rate  at  v/hich 
n"-nr>",  or  equivalently,  the  additional  number  of  observations  required 
for  the  Box-Pierce  test  to  attain  a  power  equivalent  to  the  max-x^  test 
based  on  n  observations.   We  leave  the  problem  of  determining  e  as  a 
reasonable  and  important  topic  of  future  research. 

The  final  section  of  this  chapter  will  be  devoted  to  a  consideration 
of  the  likelihood  ratio  statistic  for  testing  serial  correlation  of  the 
errors  under  the  alternative  error  model  of  (5.1.1). 
5.3  Likelihood  Ratio 

Consider  testing  the  liypothesis  H  :  0=0  under  the  alternative  error 
model 

'^t   =  ^^t-J  +  ^t'  ^''^'^^ 

V7here  {e  ]  is  wliite  noise,  and  O<|0|<1  when  H  is  true.   The  results  pre- 
t  '  '         a 

sented  in  Chapter  A  and  the  first  tv?o  sections  of  this  chapter  all  indicate 
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that  the  max-x^  test  is  a  more  powerful  procedure  for  detecting  this  model 
than  the  Box-Pierce  test.   In  this  section,  we  investigate  the  likelihood 
ratio  statistic  for  two  purposes:   (1)  to  determine  if  the  statistic  could 
practically  be  used  in  a  test  for  serial  correlation  of  the  errors  of  a 
regression  model  and  (2)  to  determine  what  form  of  test  statistic  the 
likelihood  ratio  suggests. 
5.3.1   General  Case 

We  first  derive  the  likelihood  ratio  test  for  the  general  case  of 
J  and  0  in  model  (5.3.1)  and  K,  the  number  of  sample  autocorrelations 
included  in  the  test  all  known  but  unspecified.   The  result  is  given  in 
the  following  lemma. 

Lemma  18:   Consider  a  test  of  H  :  0  =  0  versus  H_ :  0  7^  0  based 

. O  a 

upon  the  sequence  of  sample  autocorrelations  (r, ,  r„,  r^,  .  .  .,  r^^}  , 
where  0  in  the  alternative  and  J  in  model  (5.3.1)  are  known  but  unspecified 
and  where 

The  likelihood  ratio  test,  for  large  n,  is  based  upon  the  statistic 

X  =  |v|^exp{-|  .1^   r?  +f(r-p)'V~^(rP)^  (5.3.2) 

where  p '=  (p^ ,  p„,  .  .  .,  p„)  is  the  vector  of  true  autocorrelations  and 
V  is  the  variance-covariance  matrix  of  the  as>TTiptotic  distribution  of  the 
first  K  sample  autocorrelations. 

Proof:   Since  the  exact  distribution  of  the  sample  autocorrelations  is 
unknown,  we  must  base  our  likelihood  ratio  test  upon  the  asymptotic 
distribution  given  in  Section  3.3.2.   Recall  from  Lemma  1  that 
/n  (r-p)  — 5.^  %^0,V}  , 


155 


or  equivalently ,  for  large  n, 


/n  r-<,  N„{/np,V}, 


Under  H  ,  p=0  and  V=I ,  hence  the  null  likelihood  is  given  by 


L^  =  fpC/n  T-^,/n  v^,    .    .    .,  /n"rj,) 


K   1     ,2 


(2r)  ^''^expC-^  f   r?}  (5.3.3) 

2  i  =  l  J 


J 

Under  H  U  h  ,  the  likelihood  is  given  by 


L  =  fC/iTr^j/n  r^,  .  .  .  , AT  r  ) 


V 


(27F) 


kT: 


exp{-  ^  (r-p)^'"^(r-P)}  .  (5. 3. A) 


The  likelihood  ratio  test  is  based  on  the  ratio 


,_Lo^  (2.)-^/2exp{-5jy} 


^'  (2T^)-^/^\v\---'exp{-   |(r-p)'V-l(r-p)} 

=  IvfW^-^  ^'  r2  +^(r-p)'v"^r-Q)}  .        D 
2  j  =  l  J 

In  any  practical  case,  of  course,  the  alternative  value  of  0  will  be 
unknown.   Since  P  and  V  in  equation  (5.3.2)  are  functions  of  0,  maximura 
likeJihood  estimates  of  P  and  V  must  be  obtained  and  the  ratio 


A  =^=  |v|  'exp{-  ^  .£^r2  +  y(r-p) '¥"1 (r-p) ) 


L 

computed.   The  problem  reduces  to  finding  the  maximum  likelihood  estimator 

of  0,  say  0.   However,  due  to  the  complexity  of  >> ,  0  may  be  difficult  to 
obtain.   This  problem  is  avoided  if  -we   utili;ie  a  wcll-kno'.vTi  property  of 
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of  maximum  likelihood  estimators,  namely  that  if  0  is  the  maximum  likeli- 
hood estimate  (MLE)  of  0,  then  0  — ?^^     0  as  n  ->  °=.   Hannan  [16]  shows 


p.  as  n  >  CO  (Hannan's  result  is  actually  proved 


that  for  1-j-K,  r^  — - 
for  the  much  stronger  case  of  almost  sure  convergence.)   Since  pj=0  for 
model  (5.3.1),  we  have  that  r^  ■ — ?-^>-    0  as  n  ->  °°  .   Hence,  replacing 
the  MLE  0  by  the  J^h  sample  autocorrelation  rj  in  the  likelihood  ratio 
X  will  yield  an  equivalent  test  asymptotically. 

In  Sections  5.3.2  and  5.3.3,  we  consider  likelihood  ratio  tests 
for  these  special  cases  of  model  (5.3.1):  (J=5,  K=2)  and  (J=K) . 
5.3.2   Special  Case:   J=5,  K=2 

We  first  wish  to  consider  the  form  of  the  likelihood  ratio  test  when 
the  lag  J  of  model  (5.3.1)  is  larger  than  K.  Recall  that  this  is  the  case 
in  which  the  researcher  has  underestimated  the  true  lag  of  the  alternative 
error  model.  We  choose  J=5  and  K=2  in  order  to  ensure  independence  of  the 
sample  autocorrelations.  Since  V  of  equation  (5.3.2)  is  diagonal,  computa- 
tion of  the  likelihood  is  simplified  considerably.  Our  result  is  given  in 
Theorem  15. 

Theorem  15:   The  likelihood  ratio  test  of  H^:  0  =  0  versus  H^ :  0  ?^  0 


for  J=5  and  K=2  in  model  (5.3.1)  is  equivalent  to  the  Box-Pierce  test: 
reject  H  if  n  .Z  r.  is  too  large. 

o        j=l  J 

Proof:   For  che  case  J-5  and  K=2,  we  apply  Lemma  5  and  6  to  obtain  p  =  (0,0) 


and 


V  = 


1+0' 


1+0' 


NcxCj  compute 


1+0'-^ 


0 

1+0' 
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Substituting  these  quantities  into  equations  (5.3.3)  and  (5.3.4)  of 
Lemma  18,  v/e  obtain 

Since  the  form  of  L  is  workable,  we  proceed  with  finding  the  MLE  of  0, 

1-02 

or  equivalently  E,   =  .   Now 

1+02 

£n  L  =  -£n(27r)  +  £n(5)  -  j   C  (r^+r^ 
and 

d(£nL)     1   n  .  ^   ^ 

2 


Setting  the  derivative  equal  to  zero,  and  solving  for  E,   we  obtain  K=      ^      ,      \ 
Substituting  Z    for  K    in  L,  we  obtain  the  likelihood  ratio 

-  ^  Lo  ^  (2TT)"^exp{-  Y  (rj+r^)} 

L    (2TT)"i(C)exp  --J(5)(ri+rp} 

=  (fj-lexp{-  jir'i+rl)] 
7,         ^ 


exp{  -2[n(r^+r|")](r2+r2)} 

1  '  ^  2  ''  n 

2  exp{l-  2^^1^^2^'s 


n(r  +r„) 


Since  X>  C"  implies  n(r2+rp  >C,  the  likelihood  ratio  test  reduces  the 
Box-Pierce  test:  reject  H  when  n(r|+r^)>  C,  where  C  is  determined  to  make 
the  test  level  a.     Q 

This  result  lends  support  to  our  simulation  study  of  Chapter  A.   Recall 
that  the  lone  case  in  which  the  powers  of  the  Box-Pierce  test  dominated 
the  pow'er  of  the  max-x^  test  was  one  for  \;hlch  K  is  less  than  J  (K=4,  J=5)  . 
Since  the  likelihood  ratio  test  is  one  for  whicli  the  power  is  maximized 
for  fixed  significance  level  a,  the  simulation  results  are  substantiated. 
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since  „3  hope  to  choose  K  larger  than  the  hypothesized  lag  J  i„ 
the  alternative  error  „odel .  a  .ore  Important  ea.e  to  Investigate  the 

fort,  of  the  likelihood  ratio  Is  one  for  which  J<K.   However  »  he 

nuwever,  a  becomes 
very  unwieldy  when  J  is  much  less  th.n  v         ■ 

less  than  k,  since  the  possibility  of  dependent 

sample  autocorrelations  increases   Tn  M.n  f  n   • 

reases.   In  the  following  section,  we  consider 

the  special  case  (J=K) . 
l^lil_^.^c±al_Ca3ej__  J=K 

consider  no„  the  case  in  which  the  nu.her  ot  sample  antocorrelations 
-eluded  in  the  test  statistic  (K,  is  e,nal  to  the  lag  (.)  ol  the  alterna- 
tive error  „odel.   .he  following  theorem  gives  the  fo™  of  the  livelihood 


ratio  when  J=K. 


I!-I- li:  The  likelihood  ratio  statistic  for  testing  H  :  ^  .  0 
versus  H^ :  «  ,  o  when  J=K  in  „del  (5.3.1)  is  of  the  f„™ 


"^ere  g(r,,  is  so„e  function  of  r,  not  dependent  on  n.  V.  is  a  „atri.  with 

ij    element  (V--)    =  f   Ct-  ^   ^   u   ^   , 

'ij    ^ij^^K^'  ^^^h  of  the  f.j  independent  of  n,  and 

~(K-1)  =  ^^1'  ^2'  ^3'  •  •  .,  r^_^). 

Z-of :   From  Lemmas  5  and  6,  we  obtain  for  the  case  J=K 
P(K)  =  (0-  0,  0,  .  .  .,  0,  0)', 


\'K) 


?(K-1) 


whe 
.•  .  t  h 


re  V  is  KxK,  V'V  is  (.K-])x(K-l)  ,  o;     =(000 

>,  ~(K-1)    ^^''J.O,  .  .  .,  0)  and  the 


dement  of  V>^-  is    (V*)    =  f  _  (0) 
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For  matrices  of  the  form  of  V,  it  is  easy  to  show  that 


and  V 


(K) 


r"l    = 

(K) 


(V*    ) 
(K-1) 


-1 


?(K-1) 


(K-1) 


,-K/2 


1-r 


Applying  Lemma  18,  we  obtain 


(2Tr)-^/^exp{-  ^  E  r2} 
2  j  =  l  J 


L-  (2Tr)  ^/2|v* 

'  (K-1) 


-1 


^(1-02)  '^'expl-  -[r?,._Tx(V*)  r 


2^~(K-1) 


(K-1) 


1-02    ^> 


^'^^"""  ^(K-1)  =  (^r  ^2'  ^3'  •  •  •'  Vi^- 

Since  the  maximum  likelihood  estimate  of  0  will  be  very  difficult  to 
obtain  given  the  form  of  L  above,  we  will  use  the  Yule-Walker  estimate 

Again,  we  point  out 


0  =  r  .   Since  in  this  case  J=K,  we  have 


K 


that  r   is  a  consistent  estimator  of  0,  as  is  the  maximum  likelihood 
K 

estimate.   Thus,  the  likelihood  ratio  test  using  the  Yule-VJalker  estimate 
will,  for  large  n,  be  equivalent  to  the  likelihood  ratio  test  based  on 
MLE.   Substituting  r„  for  0  in  L,  we  form  the  ratio 

-        Lo  _  (2^)-K/2e^p{_^  .e/jS 
A 

K 


(27T)  ~^'^^  I  V->  [-2(1  -r2  )  -^exp{  "  -^-[ r 


-1 


pi-  "ir,^  ,,(V^<)   r      J} 
^        2  ~(K-1)       ~(K-1) 


'  l^"i'"-4'^-<"-ljiii^5'^«.i,<"^>"'r(K-i)"  • 


where 


1.1     iJ   K 
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T«u„g  !„,,  „f  ,„,,  3,,^^  ^„^  ™uip:n„,  .,  _,,  „,  „,,^,„ 


Note  that  the  dominant  term  in  the  likpl.-h   ^ 

m  the  likelihood  ratio  of  equation  (5.3.5) 

appears  to  be  nr^    q-,-^     •  -n 

De  nrj^.   Since,  m  general,  r  Z 


for  J=K,  r,„  ,.  _  P 


P   as  n  ^-  CO  ^  „g  j^g^g 

(K-1)  — ^S=.  0(j^_   and  r  _Z^  0  as  n  -.  ex,  .   Thus   for  i 

iiius,  tor  large 


nr2  J 1 .,  i(KziiI^::l!!)2l^(K- 

Similarly,  for  the  max-x^  statistic  T^'"),  ,e  have 


j,(m.) 


n  max  {rp      -  nr^ 
1-i-K    J        ^ 


-  large  n.   Hence,  the  likelihood  ratio  test  and  max-.^  test  are  as^ptoti- 
cally  equivalent.   m  order  to  more  clearly  see  the  dominance  of  the  nr^ 
--  -  the  likelihood  ratio,  .e  consider  a  simple  case:   a=K=2.   The   ^ 
result  follows  in  the  corollary. 

Corol.larx^:   The  likelihood  ratio  stat-t.V  f   .    • 

laLio  Statistic  for  testing  h  :  0  =  o 

versus  H  :  0  ^  n  for  i~v-o    ■  ,    .     ,  ° 

a   l«  ^  U  ior  J-K-2  m  model  (5.3.])  is  given  by, 

~2ln\    =^  -2£n(l+r„)  +  nr^   i  +  -ZlL. 

^      2      r2(l+r2)j  (5.3.6). 
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Proof :   We  have  previously  determined  p  and  V  for  this  case  in  Section  3.3.3.1, 
These  expressions  are  given  by, 


p  =  (0,0)'   ,  V  = 


(l+0f 

2~ 


1-i 


and 


1-C 


(1+0) 
0 


1 

1-i 


Applying  Lemma  18,  we  obtain 


and 


L^  =  (2^)  lexp{-  |(r2+r2)} 


n-e)2>)   (r2  -  0)^ 


Using  the  Yule-Walker  estimate  0  =  r,,  or  in  the  case  at  hand, 
we  substitute  r2  for  0  in  L  and  form  the  ratio 


X   =  i^  =    (2^)"   exp{-  y^l+^2>} 


(2TT)-l(l+r.)    lexp{-  il[r2    0-^+  0]} 
^  (l+r02 


Now 


(l+rjexp{-  ^(r2+r2)    +  ^{1^-       ]) 
2  2      12  2   1    ^^^2 


y\   _L   n^2    (l-r2^ 


£n\    =   ^nd+r^)    -  f  (r2+r^)   +  fr'f 


(l+r2)' 


and   thus, 


£nX    =    -2?.n(l+r2)    +  n(r2+r2)    -    nr2  (l-r|)  /  (1+r^)  2 
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1+  — 1~ +     —     -  ^1 ( 

(l+r2)2  r2  r2(l+r2)M 

=   -2.n(l.r  J   .  nrl  f  1  .  ^H  ^  ^^^^^^   "  ^1  ] 

r  2    2  2    2^) 

=  -2Jln(l+r  J    +  nr2  J  1  +  ^l3i2jLZlll2 

=   -2£n(l+r,)   +  nr^  [l  +  ^±2^^2f}}_] 

=   -2)ln(l+r    )    +  nr2  J  1  +  ^1 (  □ 

[  ^2^^-^^2>  J 

The  form  of  the  likelihood  ratio  in  (5.3.6)  is  more  easily  seen  to  be 
dominated  by  nr2  for  large  n.   Again,  when  K=J=2 ,  T^™^  =  n  irax(r?,  r|)  ~  nr 
for  large  n,  and  the  test  statistics  are  in  agreement  asymptotically. 

One  need  only  examine  equation  (5.3.6)  for  the  simple  case  (J=2,K=2) 
to  grasp  the  awkwardness  of  the  likelihood  ratio  statistic.   For  those 
cases  where  K  is  much  larger  than  J,  the  form  becomes  even  more  unwieldy 
than  eauation  (5.3.5).   Although  the  fact  that  -2Z,nX  — ^^^>-  x?  will 
enable  the  researcher  to  obtain  asymptotic  critical  regions  for  the  likeli- 
hood ratio,  the  exact  form  of  the  statistic  will  change  for  each  different 
(J,K).   For  practical  research  work  then,  the  likelihood  ratio  test  is 
unfeasible. 

The  form  of  the  ratio  does,  >iowever,  provide  an  insight  into  the 
power  simulation  results  for  the  Box-Pierce  and  m.ax-x^  tests.   For  a 
particular  case  of  K<J,  the  likelihood  ratio  is  equivalent  to  the  Box- 
Pierce  test,  while  for  K=J,  the  dominant  term  of  the  ratio  is  the  max-x^ 
statistic.   Although  the  case  J<K  yields  an  intractible  likelihood  ratio. 
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our  power  simulation  results  hint  that  some  form  of  the  max-x^  statistic 
will  be  the  dominant  term  in  the  likelihood  ratio. 

In  conclusion,  we  state  the  main  results  of  this  chapter, 
(i)   Asymptotic  power  comparisons  indicate  that  for  the  first  order 
AR  lag  J  model,  the  max-x^  test  attains  a  power  of  1  at  a 
faster  rate  than  the  Box-Pierce  test, 
(ii)   The  HLAPvE  of  the  Box-Pierce  test  to  the  max-x^  test  is  1,  i.e., 
the  limiting  ratio  of  the  sample  sizes  needed  for  the  tests 
to  have  equivalent  power  is  1. 
(iii)   The  Box-Pierce  test  was  found  to  be  asymptotically  deficient, 
in  the  sense  that  the  number  of  additional  observations  needed 
for  the  power  of  the  B-P  test  to  be  equivalent  to  the  max-x^ 
power  tends  to  infinity  as  n  grows  large. 
(iv)   The  likelihood  ratio  for  J=K  is  dominated  by  a  form  of  the 

max-x   statistic,  providing  further  support  for  the  dominance 
of  the  max-x'^  test  in  the  power  simulation  results  of  Chapter  4, 


CHAPTER  VI 
CONCLUSION 

6.1  Concluding  Remarks 
The  aim  of  this  research  has  been  to  present  a  ne^^7  test  designed 
to  detect  serial  correlation  of  the  errors  in  least  squares  regression 
models.   The  problem  of  testing  for  dependent  regression  errors  has 
been  widely  researched  since  the  early  1950 's;  however,  most  of  the 
procedures  developed  attain  high  power  only  when  the  nature  of  the 
residual  correlation  is  first  order  autoregressive.   Our  new  procedure — 

the  max-x''"  technique — is  designed  to  attain  high  power  against  a  general 

th   J 
p   order  autoregressxve  error  model. 

A  substantial  portion  of  this  research  has  been  devoted  to  a 

comparison  of  the  max-x   test  with  an  alternative  procedure  also  designed 

to  detect  serial  correlation  in  the  general  case — the  Box-Pierce  test. 

An  extensive  Monte-Carlo  simulation  study  was  undertaken  to  compare  the 

powers  of  the  two  tests  when  the  regression  errors  under  the  alternative 

hypothesis  of  serial  dependence  follow  the  first  order  lag  J  autoregressive 

process: 

\  =  ^^^t-j  +  s    > 

where   {e  }  is  white  noise.   Our  reason  for  examining  this  model  is  that 
it  represents  one  which  is  close  to  the  null  hypothesis  of  white  noise, 
and  thus  one  for  v/hich  many  testing  procedures  will  fail  to  detect  serial 
correlation.   We  hypothesized  that  under  this  model  (1)  both  the  max-  x 
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and  Box-Pierce  tests  would  have  high  power  and  (2)  that  the  max-x 
procedure  would  outperform  the  Box-Pierce  test.   Our  simulation  results 
appear  to  strongly  support  this  conjecture.   In  addition  to  the  Box-Pierce 
and  max-x^  tests,  we  also  gave  consideration  to  the  well-known  and  widely 
used  Durbin-Watson  d  test.   The  Durbin-Watson  test  performed  extremely 
well  when  J=l  in  the  AR  model,  a  result  supported  by  other  researchers. 
However,  for  J>1,  the  d  test  lacked  the  high  power  of  the  two  competing 
tests . 

In  practice,  our  recommendations  to  the  researcher  who  seeks  to 
detect  serial  correlation  in  low  order  AR  models  are: 

(i)   Apply  the  Durbin-Watson  d  test  initially,  since  it  has  high 
po;\?er  against  the  AR  lag  1  model,  a  recurrent  and  hence  most 
important  case  in  practice. 
(ii)   If  the  d  test  either  fails  to  reject  the  null  hypothesis  of 
independent  errors  or  falls  into  its  "inconclusive  region", 
apply  the  max-x   procedure,  a  test  with  high  power  against  a 
first  order  AR  error  scheme  with  lag  greater  than  1. 
We  note  that  the  researcher  should  be  concerned  with  the  overall  signifi- 
cance level  of  the  testing  procedure,  since  the  two  tests  are  not  inde- 
pendent.  We  suggest  the  Bonferroni  method  of  perfoi-ming  each  test  at 
significance  level  a/2,  for  this  guarantees  a  true  overall  significance 
level  which  is  less  than  or  equal  to  a. 

6.2  Future  Research 
Possible  avenues  for  research  in  the  area  of  testing  for  serial 
correlation  are  limitless.   Below,  we  give  three  main  areas  which  arise 
naturally  from  tlie  work  presented  in  this  dissertation. 
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(1)  Although  our  Monte-Carlo  simulation  study  was  extensive,  it  was 

by  no  means  exhaustive.   We  basically  considered  a  first  order  autoregressive 
error  model  with  a  single  non-zero  lag  parameter  (the  lag  J  not  necessarily 
1),  for  this  model  is  close  to  the  null  hypothesis  of  white  noise  and 
most  vulnerable  to  being  undetected.   However,  it  v/ould  be  interesting 
to  note  what  effect  a  general  autoregressive-moving  average  time  series 
alternative  error  model  would  have  on  the  powers  of  the  tests.   An 
extension  of  our  Monte-Carlo  simulation  to  the  general  ARI-IA  case  is  one 
possible  avenue  of  future  research. 

(2)  An  important  discovery  of  the  simulation  study  was  the  delicate- 
ness  of  the  researcher's  choice  of  K,  the  number  of  sample  autocorrelations 
to  be  included  in  the  test  statistic.   A  value  of  K  much  larger  than  the 
maxim.um  lag  in  the  alternative  error  model  will  effectively  reduce  the 
power  of  the  test,  while  K  less  than  the  minimum  lag  essentially  makes 

the  test  powerless.   McClave's  max- X  method  was  originally  designed  to 
estimate  the  order  (J)  of  autoregressive  models,  and  it  may  be  worthwhile 
for  the  researcher  to  apply  this  method  first,  and  base  his  choice  of  K 
on  the  estimated  order.   Another  possibility,  from  a  Bayesian  view,  would 
be  to  attache  a  prior  probability  on  the  possible  values  of  J.   Since 
high  power  results  when  K  is  nearly  equal  to  J,  the  mean  of  the  posterior 
distribution  of  J  may  be  of  value  in  determining  a  suitable  K.   A  method 
for  choosing  K,  then,  is  a  very  important  topic  in  future  research  of 
the  problem. 

(3)  We  have  stated  that  our  inability  to  compute  asymptotic  powers 
of  the  Box-Pierce  test  for  large  K  was  due,  in  part,  to  the  near  singu- 
larities of  the  sample  autocorrelation  covariance  matrix  (V) .   Most  of 
the  eigenvalues  of  V  in  this  instance  are  very  small  (near  zero)  and  the 
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remaining  few  considerably  larger.   This  phenomenon  of  a  near  singular 
covariance  matrix  may  very  well  be  the  reason  v/hy  the  power  of  the  Box- 
Pierce  test  diminishes  as  K  is  increased.   This  problem  was  not  as  much 
a  factor  in  the  max-x  case,  since  only  the  largest  sample  autocorrela- 
tion is  considered.   Hence  it  may  be  v7orthwhile  to  examine  tests  based 
on  the  eigenvalues  of  the  sample  covariance  matrix  of  the  sample  auto- 
correlations.  One  possibility  would  be  to  use  as  a  test  statistic  the 
maximum  eigenvalue  of  the  estimated  covariance  matrix  (V)  of  the  sample 
autocorrelations.   An  alternate  test  to  consider  is  that  which  is  based 
on  the  linear  combination  of  the  sample  autocorrelations  associated  with 
the  largest  eigenvalue  of  V.   From  principal  components  analysis,  we 
know  that  the  coefficients  of  the  linear  combination  are  simply  the 
elements  of  the  eigenvector  associated  with  the  largest  eigenvalue. 
Since  asymptotic  properties  of  principal  components  are  well  known,  the 
null  distribution  of  the  test  statistic  is  tractible  for  large  n. 
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TABLE  A-1 


POWER  SIMULATIONS: 
ERROR  MODEL  1: 


J=2,  K=4,  a=.05 


n=50 


n=200 


.^ 

Box-Pierce 

Max-x 

.9 

1.000 

1.000 

.7 

.987 

.992 

.5 

.764 

.817 

.3 

.290 

.322 

.1 

.048 

.050 

0 

.050 

.045 

.1 

.068 

.055 

.3 

.333 

.316 

.5 

.798 

.814 

.7 

.989 

.993 

.9 

1.000 

1.000 

Box-Pierce 

Max-x 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

.937 

.960 

.125 

.139 

.049 

.052 

.160 

.145 

.947 

.959 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 
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TABLE  A- 2 


POWER  SIMULATIONS: 
ERROR  MODEL  1: 


J=3,  K=4,  a=.05 


n=50 


n=200 


)_ 

Box-Pierce 

Max-x^ 

9 

1.000 

1.000 

7 

.976 

.985 

5 

.755 

.796 

3 

.304 

.322 

1 

.064 

.049 

0 

.038 

.040 

1 

.049 

.047 

3 

.258 

.281 

5 

.782 

.826 

7 

.976 

.988 

9 

1.000 

1.000 

Box-Pierce 

Max-x^ 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

.937 

.953 

.157 

.166 

.049 

.052 

.143 

.147 

.948 

.961 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 
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TABLE  A-3 


POWER  SIMULATIONS: 
ERROR  MODEL  1; 


J=4,  K=4,  a=.05 


n=50 


n=200 


)_ 

Box-Pierce 

Max-x 

9 

.999 

.999 

1 

.971 

.983 

5 

.741 

.815 

3 

.229 

.295 

1 

.052 

.037 

0 

.038 

.040 

1 

.065 

.044 

3 

.310 

.303 

5 

.760 

.775 

7 

.981 

.984 

9 

1.000 

1.000 

Box-Pierce 

Max-x 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

.926 

.949 

.118 

.140 

.056 

.059 

.164 

.156 

.938 

.958 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 
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TABLE  A- 4 

POWER  SIMULATIONS:   J=2,  K=12,  a=.05 
ERROR  MODEL  1:   ^  =0Z   2+^^ 


n=50 


n=200 


_ 

Box-Pierce 

Max-x-^ 

9 

.999 

.999 

7 

.937 

.982 

5 

.555 

.673 

3 

.175 

.184 

1 

.024 

.018 

0 

.034 

.022 

1 

.035 

.018 

3 

.199 

.173 

5 

.616 

.718 

7 

.948 

.969 

9 

1.000 

1.000 

Box-Pierce 

Max-x 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

.793 

.916 

.087 

.080 

.043 

.037 

.115 

.096 

.837 

.925 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 
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TABLE   A- 5 

POWER  SI^IULATIONS:      J=3,    K=12,    a=.05 
ERROR  MODEL   1:      Z   =0Z       +z 


n=50 


n=200 


1_ 

Box-Pierce 

Max-x^ 

Box-Pierce 

Max-x^ 

.9 

.998 

1.000 

1.000 

1.000 

.7 

.930 

.975 

1.000 

1.000 

.5 

.577 

.644 

.999 

1.000 

.3 

.173 

.156 

.809 

.907 

.1 

.020 

.014 

.103 

.097 

0 

.034 

.022 

.043 

.037 

.1 

.034 

.019 

.106 

.096 

.3 

.180 

.173 

.821 

.919 

.5 

.575 

.671 

1.000 

1.000 

.7 

.938 

.963 

1.000 

1.000 

.9 

1.000 

1.000 

1.000 

1.000 
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TABLE  A- 6 

POWER  SIMULATIONS:   J=4,  K=12,  a=.05 

ERROR  MODEL  1:  Z  =0Z   ,+e 
t    t-4   t 


n=50 


n=200 


Box-Pierce 

Max-x 

.997 

.999 

.912 

.963 

.546 

.664 

.143 

.154 

.040 

.012 

.034 

.022 

.040 

.017 

.176 

.168 

.583 

.646 

.937 

.966 

.999 

1.000 

Box-Pierce 

Max-x 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

.803 

.909 

.095 

.076 

.043 

.037 

.134 

.101 

.827 

.914 

.999 

1.000 

1.000 

1.000 

1.000 

1.000 
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TABLE  A- 7 


POWER  SIMULATIONS:   J=12,  K=12,  a=.05 


ERROR  MODEL  1: 


Z^H 


't-12+^ 


n=50 


n=200 


)_ 

Box-Pierce 

Max-x^ 

Box-Pierce 

Max-x^ 

9 

.992 

1.000 

1.000 

1.000 

7 

.755 

.910 

1.000 

1.000 

5 

.307 

.394 

1.000 

1.000 

3 

.096 

.053 

.736 

.860 

1 

.028 

.009 

.086 

.089 

0 

.034 

.022 

.043 

.037 

1 

.036 

.012 

.122 

.098 

3 

.122 

.079 

.787 

.884 

5 

.394 

.406 

.998 

1.000 

7 

.823 

.895 

1.000 

1.000 

9 

.996 

1.000 

1.000 

1.000 
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TABLE  A- 8 


POUTER  SIMULATIONS: 
ERROR  MODEL  1: 


J=12,  K=24,  a=.05 


n=50 


n=200 


)_ 

Box-Pierce 

Max-x 

Box-Pierce 

Max-x ^ 

9 

.976 

1.000 

1.000 

1.000 

7 

.583 

.853 

1.000 

1.000 

5 

.196 

.278 

.997 

1.000 

3 

.048 

.024 

.614 

.808 

1 

.012 

.008 

.063 

.058 

0 

.014 

.004 

.041 

.027 

1 

.009 

.004 

.083 

.071 

3 

.071 

.039 

.648 

.843 

5 

.259 

.298 

.994 

1.000 

7 

.664 

.837 

1.000 

1.000 

9 

.977 

1.000 

1.000 

1.000 
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TABLE  A- 9 

POWER  SIMULATIONS:   J=5, 

K=4 

,  a=.05 

ERROR 

MODEL  1:   Z^= 
n=50 

=0Z^_ 

5+S 

0 

Box-Pierce 

Max-x^ 

-.9 

.466 

.339 

-.7 

.292 

.192 

-.5 

.135 

.085 

-.3 

.075 

.051 

-.1 

.041 

.033 

0 

.058 

.048 

.1 

.047 

.035 

.3 

.082 

.057 

.5 

.157 

.104 

.7 

.287 

.194 

.9 

.454 

.331 

178 


TABLE  A- 10 


POWER 

SIMULATIONS: 

\=1,    3  =1, 

K= 

2,   a=.05 

ERROR  MODEL  2: 

l\ 

-2+^t 

n= 

50 

n=200 

h 

h 

Box-Pierce 

Max-x^ 

Box-Pierce 

Max-x^ 

-1.0 

-.6 

1.000 

1.000 

1.000 

1.000 

-  .7 

.3 

1.000 

1.000 

1.000 

1.000 

-  .5 

.3 

.993 

.986 

1.000 

1.000 

-  .3 

.1 

.584 

.568 

.989 

.987 

0 

0 

.042 

.042 

.056 

.053 

.1 

-.7 

.995 

.997 

1.000 

1.000 

.1 

.7 

.995 

.995 

1.000 

1.000 

.5 

.3 

.992 

.989 

1.000 

1.000 

.7 

.3 

1.000 

1,000 

1.000 

1.000 

1.0 

-.3 

1.000 

1.000 

1.000 

1.000 

1.0 

-.6 

1.000 

1.000 

1.000 

1.000 
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TABLE  A-11 


POt'JER  SIMULATIONS:      J-,=l,    J«=2,    K=12,    a=.05 
ERROR  MODEL   2:      ^t"*^!^  -l'*"'^2^t-2"'"^t 


n=50  n=200 


h 

°2 

Box-Pierce 

Max-x 

Box-Pierce 

Max-x ^ 

-1.0 

-.6 

.987 

.996 

1.000 

1.000 

-   .7 

.3 

1.000 

1.000 

1.000 

1.000 

-   .5 

.3 

.960 

.950 

1.000 

1.000 

-   .3 

.1 

.323 

.307 

.925 

.967 

0 

0 

.034 

.022 

.043 

.037 

.1 

-.7 

.943 

.975 

1.000 

1.000 

.1 

.7 

.966 

.992 

1.000 

1.000 

.5 

.3 

.953 

.951 

1.000 

1.000 

.7 

.3 

1.000 

1.000 

1.000 

1.000 

1.0 

-.3 

.996 

1.000 

1.000 

1.000 

1.0 

-.6 

.987 

.996 

1.000 

1.000 
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TABLE  A- 12 


POWER  SIMULATIONS:   J,=l,  J2=3,  K=4,  a=.05 
ERROR  MODEL  2:   Z  =0  Z  _i+'^ 2^^.-3^^ t 


n=50  n=200 


h 

^2 
.3 

Box-Pierce 
1.000 

Max-x^ 
1.000 

Box-Pierce 
1.000 

Max-x^ 

-1.0 

1.000 

-1.0 

.1 

.999 

1 

.000 

1.000 

1.000 

-  .5 

-  .3 

.961 

.942 

1.000 

1.000 

-  .1 

.3 

.301 

.300 

.969 

.971 

0 

0 

.038 

.040 

.049 

.052 

.1 

-  .9 

1.000 

1 

.000 

1.000 

1.000 

.1 

.7 

.983 

992 

1.000 

1.000 

.3 

-  .1 

.346 

308 

.956 

.965 

.5 

-  .3 

.903 

880 

1.000 

1.000 

.5 

-1.2 

1.000 

1 

000 

1.000 

1.000 

1.0 

.1 

1.000 

1 

.000 

1.000 

1.000 
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TABLE  A-13 

P0V7ER  SnnJLATIONS:  J=2,  K=4,  a=.05 

REGRESSION  MODEL:  Y  =.4+4.4t+Z 

ERROR  MODEL:  2;^=0Z|._2+e^ 

n=50 

0      Box-Pierce     Max-x^      Durbin-Watson  D-W  Inconclusive 

-.9                   .999                   1.000  .000  .000 

-.8                1.000                   1.000  .000  .001 

-.7                  .987                     .996  .000  .000 

-.6                   .929                     .958  .000  .001 

-.5                   .808                     .875  .001  .000 

-.4                  .564                    .637  .001  .006 

-.3                  .338                    .394  .006  .010 

-.2                   .152                     .160  .008  .018 

-.1                   .061                     .067  .026  .018 

0                     .028                     .033  .036  .035 

.1                   .054                     .050  .059  .054 

.2                   .123                     .096  .081  .057 

.3                   .287                     .235  .128  .072 

.4                  .499                    .475  .185  .088 

.5                   .691                     .704  .243  .072 

.6                   .860                     .852  ,307  .081 

.7                   .955                     .958  .409  .085 

.8                   .990                     .990  .549  .053 

.9                   .995                     .995  .703  .037 
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TABLE  A 

-14 

POV/ER  SIMULATIONS: 

J=3, 

K=4, 

a=.05 

REGPJESSION 

MODEL: 

\= 

.4+4. 

4t+Z^ 

ERROR  MODEL: 

Z^=0Z 

t-3-^^ 

t 

n=50 

_ 

Box-Pierce     Max-x^ 

Durb 

in-Watson 

D-W  Inconclusive 

9 

1.000 

1.000 

.346 

.082 

8 

.998 

.999 

.222 

.081 

7 

.990 

.997 

.140 

.072 

6 

.926 

.960 

.114 

.057 

5 

.797 

.851 

.093 

.051 

4 

.586 

.640 

.059 

.053 

3 

.309 

.317 

.037 

.038 

2 

.190 

.182 

.046 

.032 

1 

.091 

.081 

.044 

.024 

0 

.028 

.033 

.036 

.035 

1 

.067 

.051 

.052 

.054 

2 

.119 

.095 

.034 

.037 

3 

.244 

.222 

.042 

.049 

4 

.446 

.415 

.054 

.053 

5 

.644 

.655 

.077 

.072 

6 

.834 

.851 

.116 

.096 

7 

.952 

.951 

.179 

.117 

8 

.989 

.988 

.356 

.137 

9 

.999 

.999 

.584 

.108 
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TABLE 

A-15 

POWER  SIMULATIONS 

J=4, 

K=4, 

a=.05 

REGRESSION  MODEL:   Y^= 

.4+4. 

4t+Z 

ERROR  MODEL: 

Z^=0Z 

t-4 

t 

n= 

50 

Box-Pierce      Max-x^ 

Durbin-Wat 

son 

D-W  Inconclusive 

9 

1.000 

1.000 

.351 

.071 

8 

.997 

1.000 

.236 

.089 

7 

.984 

.992 

.174 

.087 

6 

.926 

.959 

.122 

.064 

5 

.774 

.840 

.080 

.053 

4 

.520 

.591 

.060 

.062 

3 

.306 

.363 

.062 

.034 

2 

.130 

.137 

.045 

.047 

1 

.059 

.053 

.043 

.028 

0 

.028 

.033 

.036 

.035 

1 

.071 

.048 

.037 

.032 

2 

.149 

.103 

.050 

.048 

3 

.273 

.218 

.056 

.033 

4 

.459 

.422 

.062 

.048 

5 

.683 

.654 

.080 

.050 

6 

.866 

.871 

.124 

.061 

7 

.945 

.945 

.186 

.057 

8 

.993 

.992 

.247 

.066 

9 

1.000 

1.000 

.338 

.058 
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TABLE 

A-16 

POInTER 

SIMULATIONS: 

J=l 

,  K=12,  a=.05 

REGRESSION  MODEL 

\ 

=.4+4.4t+Z^ 

ERROR  MODEL: 

n=50 

^^t-l+^ 

0__ 

Box-Pierce 

Max-x^ 

Durbin-Watson 

D-W  Inconclusive 

.9 

.999 

1.000 

1.000 

.000 

.8 

.994 

.999 

1.000 

.000 

.7 

.959 

.990 

.995 

.003 

.6 

.869 

.934 

.974 

.007 

.5 

.664 

.764 

.909 

.036 

.4 

.452 

.528 

.779 

.081 

.3 

.230 

.263 

.505 

.127 

.2 

.123 

.105 

.286 

.089 

.1 

.055 

.044 

.095 

.061 

0 

.028 

.019 

.030 

.070 

.1 

.033 

.020 

.048 

.042 

.2 

.077 

.045 

.188 

.086 

.3 

.165 

.130 

.408 

.106 

.4 

.331 

.313 

.661 

.094 

.5 

.503 

.545 

.862 

.055 

.6 

.724 

.796 

.953 

.020 

.7 

.869 

.920 

.988 

.006 

.8 

.947 

.975 

.996 

.004 

.9 

.983 

.992 

1.000 

.000 
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TABLE  A-17 


POWER  SIMULATIONS:   J=4,  K=12,  a=.05 
REGRESSION  MODEL:   Y  =.4+4.4t+Z 

ERROR  MODEL:   Z  =0Z   ,+e^ 
t    t-4   t 


n=50 


^ 

Box-Pierce 

Max-x 

Durbin-Watson 

D-VJ  Inconclusive 

.9 

.993 

.999 

.338 

.076 

.8 

.977 

.992 

.252 

.081 

.7 

.928 

.973 

.188 

.057 

.6 

.765 

.905 

.113 

.069 

.5 

.586 

.721 

.084 

.063 

.4 

.359 

.466 

.074 

.057 

.3 

.192 

.215 

.042 

.040 

.2 

.090 

.073 

.049 

.042 

.1 

.047 

.028 

.042 

.037 

0 

.028 

.019 

.030 

.070 

.1 

.054 

.031 

.036 

.036 

.2 

.102 

.061 

.064 

.031 

.3 

.180 

.129 

.046 

.044 

.4 

.331 

.292 

.072 

.059 

.5 

.548 

.528 

.097 

.051 

.6 

.742 

.753 

.144 

.055 

.7 

.903 

.926 

.181 

.057 

.8 

.968 

.973 

.234 

.073 

,9 

.989 

.996 

.332 

.058 
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TABLE  A- 18 

POWER  SIMULATIONS:   J=4  v=a      „_  o^ 

REGRESSION  MODEL:  Y^=21.548-:2544t+!o527V..Z 

ERROR  MODEL:   Z  =0Z   +e  ^ 

t   t-4  t 


n=50 


_0_ 

Box-Pierce 

Max-x^ 

Durbin-W 

-.9 

.999 

.999 

.332 

-.8 

.999 

1.000 

.194 

-.7 

.982 

.991 

.150 

-.6 

.925 

.960 

.083 

-.5 

.790 

.839 

.064 

-.4 

.546 

.642 

.049 

-.3 

.330 

.370 

.050 

-.2 

.152 

.172 

.022 

-.1 

.078 

.030 

.033 

0 

.067 

.058 

.032 

.1 

.081 

.080 

.029 

.2 

.149 

.106 

.037 

.3 

.295 

.221 

.061 

.4 

.509 

.431 

.070 

.5 

.717 

.637 

.099 

.6 

.865 

.835 

.133 

.7 

.963 

.954 

.205 

,8 

.991 

.992 

.283 

.9 

.999 

.999 

.358 

^^   Inconclus] 

.147 

.156 

.148 

.143 

.118 

.093 

.079 

.083 

.071 

.043 

.085 

.107 

.095 

.098 

.112 

.153 

.131 

.135 

.118 
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TABLE  A- 19 

POWER  SnnjLATIONS:   J=l,  K=12,  a=.05 
REGRESSION  MODEL:   Y  =21.548-.25A4t+.05727t2+Z^ 

ERROR  MODEL:   ^^^^^   +e 
n=50 


l_ 

Box-Pierce 

9 

Max-x 

Durbin-Watson 

D-W  Inconclusive 

.9 

.999 

1.000 

1.000 

.000 

.8 

.995 

.999 

.999 

.001 

.7 

.955 

.990 

.995 

.003 

.6 

.881 

.944 

.974 

.020 

.5 

.667 

.814 

.992 

.057 

.4 

.438 

.552 

.751 

.144 

.3 

.247 

.307 

.522 

.224 

.2 

.130 

.114 

.240 

.222 

.1 

.065 

.056 

.077 

.144 

0 

.047 

.030 

.024 

.073 

.1 

.047 

.025 

.031 

.082 

.2 

.091 

.056 

.105 

.158 

.3 

.180 

.115 

.271 

.201 

.4 

.333 

.260 

.505 

.233 

.5 

.535 

.489 

.768 

.121 

.6 

.699 

.690 

.860 

.085 

.7 

.841 

.844 

.962 

.022 

.8 

.938 

.946 

.984 

.011 

.9 

.961 

.964 

.994 

.003 
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TABLE  A-20 

POWER  SIMULATIONS:   J=4,  K=12,  a=.05 
REGRESSION  MODEL:   Y  =21.548-. 2544t+.05727t2+Zj 

ERROR  MODEL:   Z  =0Z   ,+e 
t    t-4   t 


n=50 


0_ 

Box-Pierce 

Max-x 

Durbin-Watson 

.9 

1.000 

1.000 

.320 

.8 

.985 

.997 

.201 

.7 

.922 

.973 

.149 

.6 

.792 

.885 

.122 

.5 

.573 

.720 

.060 

.4 

.374 

.459 

.042 

.3 

.189 

.215 

.037 

.2 

.110 

.093 

.029 

.1 

.059 

.040 

.039 

0 

.047 

.030 

.024 

.1 

.064 

.038 

.035 

.2 

.112 

.054 

.030 

.3 

.209 

.133 

.042 

.4 

.373 

.279 

.069 

.5 

.608 

.516 

.101 

.6 

.781 

.748 

.150 

.7 

.923 

.908 

.186 

.8 

.973 

.974 

.251 

.9 

.997 

.998 

.333 

D-W  Inconclusive 

.158 
.155 
.149 
.139 
.111 
.128 
.090 
.098 
.069 
.073 
.081 
.081 
.081 
.128 
.122 
.152 
.135 
.143 
.125 
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TABLE  A- 21 

^   POU^R  SIMULATIONS:   J=2,  K=4,  a=.05 

REGRESSION  MODEL:   Y  =. 84+. 093X-. 00057 t+Z^ 

X  =.8+,8X   ,-fii 
t       t-1   t 

ERROR  MODEL:   ^  -0Z   +e^ 


n=50 


Box-Pierce 

Max-x 

Durbln-Watson 

9 

1.000 

1.000 

.000 

7 

.987 

.996 

.000 

5 

.831 

.876 

.000 

3 

.341 

.407 

.002 

1 

.072 

.074 

.014 

0 

.044 

.042 

.026 

1 

.061 

.040 

.042 

3 

.255 

.214 

.125 

5 

.665 

.632 

.217 

7 

.945 

.946 

.425 

9 

.992 

.999 

.747 

D-W  Inconclusive 
.000 
.001 
.006 
.029 
.070 
.084 
.116 
.130 
.175 
.127 
.067 
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TABLE  A- 22 


POVffiR  SIMULATIONS:   J=4,  K=4,  a=.05 
REGRESSION  MODEL:   Y  =.84+.098Xt.-,  00057t+Z 

ERROR  MODEL:   Z  =0Z   ,+e: 
t  ^   t-4   t 


n=50 


0_ 

Box-Pierce 

Max-x 

Durbin-Watson 

D-W  Inconclusive 

.9 

1.000 

1.000 

.324 

.169 

.7 

.980 

.987 

.145 

.174 

.5 

.756 

.824 

.079 

.123 

.3 

.299 

.334 

.040 

.100 

.1 

.063 

.059 

.032 

.082 

0 

.044 

.042 

.026 

.084 

.1 

.062 

.058 

.031 

.079 

.3 

.289 

.233 

.038 

.089 

.5 

.700 

.665 

.077 

.113 

.7 

.953 

.954 

.155 

.117 

.9 

1.000 

.999 

.303 

.109 
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TABLE  A- 2 3 

POWER  SIMULATIONS:   J=l,  K=12,  a=.05 
REGRESSION  MODEL:   Y^=.84+.098X  -. 00057 t+Z 


•4 

=.8+.8X 

.K 

.,u..^ 

ERROR  MODEL: 

\=^h- 

-1+^ 

n- 

50 

0 

Box-Pierce 

Max-x^ 

Durbin-Watson 

D-U  Inconclusive 

-.9 

.999 

.999 

1.000 

.000 

-.8 

.991 

.998 

.999 

.000 

-.7 

.960 

.988 

.998 

.000 

-.6 

.860 

.935 

.980 

.016 

-.5 

.653 

.783 

.901 

.061 

-.4 

.433 

.527 

.739 

.141 

-.3 

.  251 

.286 

.481 

.229 

-.2 

.138 

.105 

.234 

.212 

-.1 

.055 

.036 

.088 

.138 

0 

.047 

.032 

.029 

.083 

.1 

.037 

.018 

.044 

.086 

.2 

.067 

.039 

.110 

.182 

.3 

.133 

.097 

.300 

.224 

.4 

.270 

.244 

.544 

.188 

.5 

.460 

.492 

.752 

.147 

.6 

.668 

.720 

.912 

.054 

.7 

.845 

.889 

.968 

.022 

.8 

.928 

.959 

.990 

.007 

.9 

.965 

.984 

.997 

.001 
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TABLE  A- 24 

POWER  SIMULATIONS:   J=4,  K=12,  a=.05 
REGRESSION  MODELS:  Y  =.84+.098X  -.00057t+Z 

ERROR  MODEL:   Z  =0Z   ,+e 
t    t-4   t 


n=50 

1_ 

Box-Pierce 

Max-x^ 

Durbin-Watson 

D-W  Inconclusive 

-.9 

1.000 

1.000 

.342 

.146 

-.8 

.989 

.998 

.199 

.183 

-.7 

.932 

.977 

.122 

.175 

-.6 

.807 

.902 

.078 

.160 

.5 

.576 

.729 

.059 

.119 

.4 

.355 

.457 

.045 

.098 

.3 

.199 

.202 

.032 

.101 

.2 

.099 

.074 

.027 

.091 

.1 

.049 

.039 

.209 

.083 

0 

.047 

.032 

.029 

.083 

.1 

.063 

.034 

.029 

.084 

.2 

.104 

.054 

.041 

.079 

.3 

.204 

.121 

.049 

.090 

.4 

.358 

.277 

.058 

.102 

.5 

.533 

.522 

.078 

.110 

.6 

.755 

.748 

.104 

.106 

.7 

.912 

.923 

.147 

.115 

.8 

.973 

.979 

.194 

.131 

.9 

.996 

.996 

.282 

.105 
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TABLE  A- 

-25 

POWER 

SIMULATIONS: 

J= 

2,  K=4, 

a= 

.05 

REGRESSION 

MODEL: 

Y=2 
^2t= 

14+.69X  - 

-.63 

^']   Cov( 
2t 

^t'^2t^  =  -^ 

ERROR  MODEL:   . 

7    = 

0Zt-2+^ 

t 

n=50 

Box-Pierce 

Max-x^ 

Durb 

in-Watson 

D-W 

Inconclusive 

9 

1.000 

1.000 

.000 

.000 

8 

.996 

.997 

.000 

.000 

7 

.989 

.992 

.000 

.000 

6 

.943 

.962 

.000 

.002 

5 

.793 

.857 

.000 

.006 

4 

.561 

.634 

.000 

.015 

3 

.333 

.373 

.002 

.025 

2 

.158 

.171 

.012 

.026 

1 

.059 

.068 

.014 

.048 

0 

.037 

.035 

.032 

.034 

1 

.062 

.042 

.038 

.093 

2 

.124 

.093 

.058 

.111 

3 

.250 

.216 

.094 

.123 

4 

.461 

.437 

.126 

.143 

5 

.701 

.699 

.185 

.143 

6 

.871 

.874 

.250 

.142 

7 

.959 

.965 

.329 

.153 

8 

.992 

.994 

.453 

.125 

9 

.998 

.998 

.577 

.096 
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TABLE  A- 2 6 


POWER  SIMULATIONS:   J=4,  K=4,  a=.05 

REGRESSION  MODEL:   Y^=2.14+.  69Xt  ^-.  63X_+Z^ 
t  It     It   t 


It       l,t-l   It  ,   „   ,       >._  ^ 


ERROR  MODEL:   Z  =0Z  ,+c 
t        t-4   t 


n=50 

Box-Pierce 

Max-  x^ 

Durb 

in-Watson 

D-W  Inconclusive 

9 

1.000 

1.000 

.348 

.143 

7 

.971 

.986 

.148 

.154 

5 

.726 

.767 

.065 

.111 

3 

.245 

.285 

.035 

.091 

1 

.055 

.051 

.208 

.080 

0 

.037 

.035 

.032 

.034 

1 

.062 

.040 

.022 

.085 

3 

.274 

.224 

.025 

.102 

5 

.689 

.672 

.046 

.119 

7 

.954 

.955 

.100 

.109 

9 

.999 

.999 

.211 

.096 
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TABLE  A- 2 7 

POv-JER  SIMULATIONS:   J=l,  K=12,  a=.05 
REGRESSION  MODEL:   Y  =2.14+.69X  -.63X  +Z 

ERROR  MODEL:   Z  =0Z  _■,  +  Z 
n=50 


0_ 

Box-Pierce 

Max-x^ 

Durbin-Watson 

D-W  Inconclusive 

.9 

1.000 

1.000 

1.000 

.000 

.8 

.986 

.993 

1.000 

.000 

.7 

.942 

.977 

.985 

.010 

.6 

.839 

.909 

.959 

.023 

.5 

.633 

.747 

.869 

.084 

.4 

.399 

.483 

.690 

.157 

.3 

.216 

.226 

.436 

.215 

.2 

.104 

.073 

.182 

.219 

.1 

.051 

.028 

.054 

.122 

0 

.  030 

.014 

.017 

.080 

.1 

.041 

.018 

.056 

.090 

.2 

.071 

.040 

.150 

.175 

.3 

.138 

.116 

.358 

.231 

.4 

.273 

.290 

.624 

.180 

.5 

.459 

.570 

.826 

.105 

.6 

.690 

.790 

.943 

.034 

.7 

.869 

.926 

.988 

.011 

.8 

.957 

.989 

1.000 

.000 

.9 

.991 

.998 

1.000 

.000 

196 


TABLE  A-28 

POWER  SIMULATIONS:   J=4,  K=12,  a=.05 
REGRESSION  MODEL:   Y^=2.14+.69X  -.63X  +Z 

ERROR  MODEL:   Z  =0Z  ,+e 
t    t-4   t 


D-w  Inconclusive 

.145 
.160 
.7        .917        .968  .123  .145 

.6        .774        .864  .088  .135 

.5        .539         .665  .065  .125 

.4        .327        .415  .045  .105 

.3        .166        .179  .033  .088 

.2        .087         .069  .028  .079 

.1        .042         .022  .022  .074 

0       .030        .014  .017  .080 

.1        .035         .020  .020  .074 

.2        .063        .038         .025  .076 

.3        .150        .117         .209  .078 

.4        .286         .293  .036  .093 

.5        .505         .545  .048  .095 

.6        .712         .776  .072  ,096 

.7        .877         .933  .101  .118 

.120 
.110 


n=50 

Box-Pierce 

Max-x^ 

Durbin-Watson 

.999 

1.000 

.309 

.983 

.996 

.190 

.917 

.968 

.123 

.774 

.864 

.088 

.539 

.665 

.065 

.327 

.415 

.045 

.166 

.179 

.033 

.087 

.069 

.028 

.042 

.022 

.022 

.030 

.014 

.017 

.035 

.020 

.020 

.063 

.038 

.025 

.150 

.117 

.209 

.286 

.293 

.036 

.505 

.545 

.048 

.712 

.776 

.072 

.877 

.933 

.101 

.969 

.986 

.143 

.996 

.997 

.220 
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TABLE  A- 2 9 

POWER  APPROXIMATIONS:   Box-Pierce  Test 
ERROR  MODEL  1:   J=2,  K=4,  a=.05 

BP(1)  =  Imhoff  numerical  integration     BP(2)  =  Pearson  3-moment  extension 
BP(3)  =  Rao  square  root  transformation   BP(4)  =  Simulated  Power 

n=50  n=200 

0   BP(1)   BP(2)   BP(3)   BP(A)         BP(1)   BP(2)   BP(3)   BP(4) 

1.000  1.000  1.000  1.000 

1.000  1.000  1.000  1.000 

1.000  1.000  .999  1.000 

.944  1.000  .888  .937 


-.9 

1.000 

1.000 

1.000 

1.000 

-.8 

1.000 

1.000 

.999 

1.000 

-.7 

.998 

1.000 

.993 

.987 

-.6 

.996 

1.000 

.963 

.917 

-.5 

.839 

1.000 

.765 

.775 

-.4 

.606 

.874 

.488 

.552 

-.3 

.352 

.304 

.218 

.283 

_,2 

.164 

.097 

.060 

.114 

-.1 

.070 

.052 

.010 

.036 

0 

.050 

.050 

.002 

.050 

.1 

.094 

.054 

.010 

.062 

.2 

.225 

.147 

.060 

.162 

.3 

.451 

.501 

.218 

.334 

.4 

.708 

1.000 

.488 

.588 

.5 

.900 

1.000 

.765 

.828 

.6 

.983 

1.000 

.963 

.946 

.7 

.999 

1.000 

.993 

.979 

.8 

1.000 

1.000 

.999 

1.000 

.9 

1.000 

1.000 

1.000 

1.000 

163 

.116 

.051 

.125 

050 

.050 

.002 

.049 

192 

.140 

.051 

.160 

.958  1.000  .888  .947 

1.000  1.000  .999  1.000 

1.000  1.000  1.000  1.000 

1.000  1.000  1.000  1.000 
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TABLE  A- 30 

POWER  APPROXIMATIONS:   Max-x^  Test 
ERROR  MODEL  1:   J=2,  K=4»  a=.05 


M(l)  =  Taylor-series  approximation    M(2)  =  Simulated  power 

n=200 
M(l)  M(2) 

1.000  1.000 

1.000  1.000 

1.000  1.000 

.967  .960 


n=50 

0_ 

M(l) 

M(2) 

.9 

1.000 

1.000 

.8 

1.000 

1.000 

.7 

.999 

.994 

.6 

.987 

.948 

.5 

.889 

.827 

.4 

.653 

.602 

.3 

.370 

.320 

.2 

.163 

.118 

.1 

.068 

.040 

0 

.050 

.045 

.1 

.086 

.057 

.2 

.198 

.144 

.3 

.415 

.325 

.4 

.692 

.573 

.5 

.908 

.814 

.6 

.990 

.958 

.7 

.999 

.988 

.8 

1.000 

1.000 

.9 

1.000 

1.000 

.167 

.139 

.050 

.052 

.183 

.145 

.970  .959 


1.000  1.000 


1.000  1.000 


1.000  1.000 
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TABLE  A- 31 

POWER  APPROXIMATIONS:   Box-Pierce  Test 
ERROR  MODEL  1:   J=3,  K=4,  a =.05 

BP(1)  =  Imhoff  numerical  integration      BP(2)  =  Pearson  3-moment  extension 
BP(3)  =  Rao  square  root  transformation    BP(4)  =  Simulated  power 

n=50  n=200 

0   BP(1)   BP(2)   BP(3)   BP(4)        BP(1)   BP(2)   BP(3)   BP(4) 

-.9  1.000  1.000  1.000  1.000                   1.000     1.000     1.000     1.000 

-.8  1.000  1.000  .999  .998 

-.7  .999  1.000  .993  .976                   1.000     1.000     1.000     1.000 

-.6  .978  1.000  .936  .913 

-.5  .873  1.000  .764  .768                   1.000     1.000        .999      1.000 

-.4  .652  .845  .488  .533 

-.3  .391  .369  .217  .291                     .953        .998        .888        .937 

-.2  .189  .132  .060  .131 

-.1  .081  .060  .010  .049                     .176        .134        .051        .157 

0  .050  .050  .002  .038                     .050        .050        .002        .049 

.1  .081  .060  .010  .053                     .176        .134        .051        .143 

.2  .189  .132  .060  .151 

.3  .391  .359  .217  .318                     .953        .998        .888        .948 

.4  .652  .845  .488  .524 

.5  .873  1.000  .764  .750                   1.000     1.000        .999      1.000 

.6  .978  1.000  .936  .917 

.7  .999  1.000  .993  .982                   1.000     1.000      1.000      1.000 

.8  1.000  1.000  .999  .999 

.9  1.000  1.000  1.000  1.000                   1.000     1.000     1.000      1.000 


200 


TABLE  A- 3 2 

POWER  APPROXIMATIONS:   Max-x^  Test 
ERROR  MODEL  1:   J=3,  K=4,  a=.05 

M(l)  =  Taylor-series  approximation        M(2)  =  Simulated  power 


5__ 

M(l) 

M(2) 

M(l) 

M(2) 

9 

1.000 

1.000 

1.000 

1.000 

8 

1.000 

.999 

7 

.999 

.984 

1.000 

1.000 

6 

.987 

.942 

5 

.989 

.817 

1.000 

1.000 

4 

.671 

.550 

3 

.388 

.311 

.969 

.953 

2 

.176 

.112 

1 

.075 

.048 

.174 

.166 

0 

.050 

.040 

.050 

.052 

1 

.075 

.046 

.174 

.147 

2 

.176 

.142 

3 

.388 

.316 

.969 

.961 

4 

.671 

.554 

5 

.898 

.806 

1.000 

1.000 

6 

.987 

.937 

7 

.999 

.986 

1.000 

1.000 

8 

1.000 

1.000 

9 

1.000 

1.000 

1.000 

1.000 
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TABLE  A- 33 

POWER  APPROXIMATIONS:   Box-Pierce  Test 
ERROR  MODEL  1:   J=4,  K=4,  a=.05 

BP(1)  =  Imhoff  numerical  integration     BP(2)  =  Pearson  3-moment  extension 
BP(3)  =  Rao  square  root  transformation   BP(4)  =  Simulated  power 


n= 

=50 

n= 

200 

0 

BP(1) 

BP(2) 

BP(3) 

BP(4) 

BP(1) 

BP(2) 

BP(3) 

BP(4) 

-.9 

1.000 

1 

000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

-.8 

1.000 

1 

.000 

.999 

.996 

-.7 

.999 

1 

.000 

.995 

.984 

1.000 

1.000 

1.000 

1.000 

-.6 

.973 

1 

.000 

.926 

.891 

-.5 

.843 

.999 

.700 

.713 

1.000 

1.000 

1.000 

1.000 

-.4 

.607 

.698 

.391 

.478 

-.3 

.345 

.312 

.157 

.236 

.947 

.995 

.888 

.926 

-.2 

.159 

114 

.044 

.107 

-.1 

.069 

.055 

.008 

.044 

.161 

.123 

.047 

.118 

0 

.050 

050 

.002 

.038 

.050 

.050 

.002 

.056 

.1 

.092 

068 

.008 

.074 

.190 

.147 

.047 

.164 

.2 

.218 

.164 

.044 

.167 

.3 

.441 

446 

.057 

.320 

.960 

.998 

.888 

.938 

.4 

.706 

.878 

.391 

.522 

.5 

.906 

1 

.000 

.700 

.776 

1.000 

1.000 

1.000 

1.000 

.6 

.987 

1 

.000 

.926 

.921 

.7 

1.000 

.1 

000 

.995 

.986 

1.000 

1.000 

1 .  000 

1.000 

.8 

1.000 

1 

.000 

.999 

.998 

.9 

1.000 

1 

.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 
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TABLE  A-34 

POWER  APPROXIt^TIONS :   Max-x^  Test 
ERROR  MODEL  1:   J=4,  K=4,  a=.05 


M(l)  =  Taylor-series  approximation        M(2)  =  Simulated  power 
n=50  n=200 

M(l)     M(2)  M(l)     M(2) 

1.000    1.000 

1.000    1.000 

1.000    1.000 

.968     .949 


-.9 

1.000 

1.000 

-.8 

1.000 

.999 

-.7 

.999 

.993 

-.6 

.987 

.937 

-.5 

.895 

.764 

-.4 

.664 

.538 

-.3 

.376 

.269 

-.2 

.165 

.110 

-.1 

.068 

.043 

0 

.050 

.040 

.1 

.085 

.063 

.2 

.198 

.136 

•3 

.418 

.300 

.4 

.698 

.529 

.5 

.911 

.792 

.6 

.990 

.937 

.7 

.999 

.991 

.8 

1.000 

.997 

,9 

1.000 

1.000 

.168 

.140 

.050 

.059 

.183 

.156 

,970     .958 


1.000    1.000 


1.000    1.000 


1.000    1.000 
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TABLE  A- 3 5 

TAYLOR-SERIES  APPROXIMATION 
TERM  BY  TERM:   T^-T, 
n=50        (J=2,  K=4)    ^   a=. 

05 

5 

^0 

^1 

h 

^3 

^4 

^5 

^6 

Sum(M  ) 
o 

9 

,000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

7 

.000055 

.000258 

.000343 

-.000092  - 

.000451 

-.000093 

.000178 

.000198 

5 

.082481 

.046790 

-.013580 

-.001249  - 

.002504 

-.000290  - 

.000368 

.111281 

3 

.611447 

.016303 

.003511 

-.001047  - 

.000088 

-.000186  - 

.000057 

.629888 

1 

.931253 

.000099 

.000349 

.000004  - 

.000005 

.000000 

.000000 

.931710 

1 

.913725 

.000097 

.000542 

.000004  - 

.000008 

.000000 

.000000 

.914375 

3 

.563102 

.015018 

.008289 

-.000919  - 

.000012 

-.000172 

.000090 

.585396 

5 

.064378 

.036520 

-.006319 

-.000165  - 

.002013 

-.000226  - 

.000249 

.091926 

7 

.000029 

.000135 

.000186 

-.000039  - 

.000228 

-.000048 

.000091 

.000125 

9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 
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TABLE  A- 3 6 


TAYLOR-SERIES  APPROXIMATION 

TERM  BY  TERM:   T„-T, 
(J   0 


n=200 

(J=2, 

K=4)  " 

a=.05 

0 

^0 

^1 

h 

^3 

^4 

^ 

^6 

Sum(M  ) 
o 

-.9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

-.7 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

-.5 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

-.3 

.028312 

.008087  - 

.004553 

.000217 

.000064 

.000108 

.000032 

.032368 

-.1 

.831606 

.000569 

.000513 

.000002  - 

.000005 

.000000 

.000000 

.832685 

.1 

.815953 

.000558 

.000681 

.000002  - 

.000002 

.000000 

.000000 

.817193 

.3 

.026166 

.007447  - 

.003958 

.000222 

.000056 

.000100 

.000360 

.030069 

.5 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.7 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 
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TABLE  A- 3 7 


TAYLOR-SERIES  APPROXIMATION 


n=50 


TERM  BY  TERiM: 

(J=3,  K--=4) 


T  -T 
^0  6 


a=.05 


Suin(M  ) 


9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

7 

.000180 

.000049 

-.000002 

.000004 

.000000 

.000010 

.000241 

5 

.096589 

.004883 

-.000092 

.000085 

-.000005 

.000306 

.101766 

3 

.607383 

.003912 

-.000020 

.000418 

-.000001 

.000060 

.611753 

1 

.924005 

.000332 

.000000 

,000010 

.000000 

.000000 

.924348 

1 

.924005 

.000332 

.000000 

.000010 

.000000 

.000000 

.924348 

3 

.607383 

.003912 

-.000020 

.000418 

-.000001 

.000060 

.611753 

5 

.096589 

.004883 

-.000092 

.000085 

.000005 

.000306 

.101766 

7 

.000180 

.000049 

-.000002 

.000004 

.000000 

.000010 

.000241 

9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

NOTE:   T   =  .000000  for  all  values  of 
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TABLE  A- 3c 


TAYLOR-SERIES  APPROXIMATION 


TERM  BY  TERM:   T  -T, 
n=200        (J=3,  K=4) 


a=,05 


Sum(M  ) 


.9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.7 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.5 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.3 

.030968 

.000199 

.000001 

.000021 

.000003 

.031190 

.1 

.825715 

.000297 

.000000 

.000009 

.000000 

.826021 

.1 

.825715 

.000297 

.000001 

.000009 

.000000 

.826021 

.3 

.030968 

.000199 

.000000 

.000021 

.000003 

.031190 

.5 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.7 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

NOTE: 


T  =  .000000  for  all  values  of 
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TABLE  A- 3 9 


TAYLOR-SERIES  APPROXIMATION 


n=50 


TERM  BY  TERII: 

(J=4,  K=4) 


T  -T 
0   8 


a=.05 


Sum(M  ) 


.9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.7 

.000211 

.000021 

.000001 

.000000 

.000005 

.000238 

.5 

.102061 

.002087 

.000058 

.000166 

.000409 

.104782 

.3 

.621144 

.001826 

.000219 

.000046 

.000004 

.623240 

.1 

.931273 

.000166 

.000005 

.000000 

.000000 

.931446 

.1 

.914089 

.000163 

.000005 

.000000 

.000000 

.914257 

.3 

.579597 

.001704 

.000205 

.000043 

.000003 

.581553 

.5 

.086720 

.001773 

.000049 

.000141 

.000348 

.089032 

.7 

.000148 

.000014 

.000001 

.000000 

.000004 

.000168 

.9 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

NOTE:   T  =  T  =  T  =  T  =  .000000  for  all  values  of 
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TABLE  A-40 


TAYLOR-SERIES  APPROXIMATION 


n=200 


TERM  BY  TERI-I: 

(J=4,  K=4) 


T  -T 
0  8 


a=.05 


Sum(M  ) 


9 

.000000 

.000000 

.000000 

.000000 

.000000 

7 

.000000 

.000000 

.000000 

.000000 

.000000 

5 

.000000 

.000000 

.000000 

.000000 

.000000 

3 

.031669 

.000093 

.000011 

.000002 

.031776 

1 

.832211 

.000148 

.000005 

.000000 

.832364 

1 

.816853 

.000145 

.000005 

.000002 

.817003 

3 

.029551 

.000087 

.000010 

.000000 

.029651 

5 

.000000 

.000000 

.000000 

.000000 

.000000 

7 

.000000 

.000000 

.000000 

.000000 

.000000 

9 

.000000 

.000000 

.000000 

.000000 

.000000 

NOTE:   T  =  T  =  T 


T  =  T 
7    E 


,000000  for  all  values  of  0. 
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